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ABSTRACT 

We report a measurement of the real space (not redshift space) power spectrum of 
galaxies over four and a half decades of wavenumber, 0.01 to 300/iMpc^^, from the 
IRAS Point Source Catalog Redshift Survey (PSCz). Since estimates of power are 
highly correlated in the nonlinear regime, we also report results for the prewhitened 
power spectrum, which is less correlated. The inferred bias between optically-selected 
APM and I/?^5-selected PSCz galaxies is about 1.15 at linear scales ^ 0.3/iMpc~^, 
increasing to about 1.4 at nonlinear scales <; 1 /i Mpc^^ . The nonlinear power spectrum 
of PSCz shows a near power-law behaviour to the smallest scales measured, with 
possible mild upward curvature in the broad vicinity of fc ^ 2ft,Mpc~^. Contrary to 
the prediction of unbiased Dark Matter models, there is no prominent inflection at 
the linear-nonlinear transition scale, and no turnover at the transition to the virialized 
regime. The nonlinear power spectrum of PSCz requires scale-dependent bias: all Dark 
Matter models without scale-dependent bias are ruled out with high confidence. 

Key words: cosmology - large-scale structure of Universe 



1 INTRODUCTION 



. 1^ The power spectrum of galaxies can set powerful constraints 
: on cosmological parameters (Eisenstein, Hu & Tegmark 
1988; Tegmark, Zaldarriaga & Hamilton 2001). But while 
^ the cleanest information lies at large, linear scales, most of 
the data is at smaller, nonlinear scales. Potentially, there is 
much to be gained by pushing to smaller scales. 

The galaxy power spectrum is complicated by nonlin- 
earity, redshift distortions, and galaxy-to-mass bias. Even 
without bias, nonlinear redshift distortions pose a problem. 
Whereas linear redshift distortions are well understood 
(Kaiser 1987; Hamilton 1998), nonlinear redshift distortions 
are not (Hatton & Cole 1997, 1999). Nonhnear redshift 
distortions are of considerable interest in their own right 
(Kepner, Summers & Strauss 1997; Davis, Miller & White 
1997; Jing, Mo & Borner 1998; Strauss, Ostriker & Cen 1998; 
Landy, Szalay & Broadhurst 1998; Baker et al. 2000), but 
they muddy interpretation of the power spectrum observed 
in redshift space. 

Fortunately, the effect of redshift distortions, linear 
or nonlinear, biased or not, can be practically eliminated. 
Because redshift distortions displace galaxies only in the 
radial direction, the power spectrum in directions transverse 
to the line-of-sight is unaffected by redshift distortions. The 
fact that the angular clustering of galaxies is unaffected 



by redshift distortions has been used by many authors to 
deduce the real space correlation function or power spectrum 
(Groth & Peebles 1977; Davis & Peebles 1983; Saunders, 
Rowan-Robinson & Lawrence 1992; Fisher et al. 1994a; 
Loveday et al. 1995; Baugh 1996; Gaztahaga & Baugh 1998; 
Ratcliffe et al. 1998; Jing, Mo & Borner 1998; Guzzo et al. 
2000; Dodelson & Gaztafiaga 2000; Eisenstein & Zaldarriaga 
2001). 

While large angular surveys, such as the Automatic 
Plate Measuring survey (APM) (Maddox et al. 1990a,b, 
1996), or the Edinburgh/Durham Southern Galaxy Cata- 
logue (EDSGC) (Nichol, Collins & Lumsden 2001), might 
seem to offer the most natural data sets for measuring 
the real space power spectrum, redshift surveys contain 
additional information - the redshifts of galcixies - that can 
be exploited to great effect. That is, even if the redshift 
of a galaxy does not determine its precise distance, it 
nevertheless constrains that distance within narrow limits. 
The additional redshift information allows the real space 
power spectrum to be measured from a redshift survey with 
accuracy comparable to that from an angular survey many 
times larger (§3.2). 

The goal of the present paper is to measure the real 
space power spectrum of the recently published IRAS Point 
Source Catalog Redshift Survey (PSCz) (Saunders et al. 
2000). Large volume and careful attention to uniformity of 
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Figure 1. Contour plot of the redshift space power spectrum P''(kj_, fe||) of the PSCz 0.6 Jy survey at nonlinear scales. Power along 
the transverse (horizontal) axis is unaffected by redshift distortions, and is therefore equal to the real space power spectrum. Velocity 
dispersion suppresses power away from the transverse axis. The plotted redshift power is constructed from the harmonics of redshift 
power, truncated at the fe-dependent maximum harmonic given by equations (13) and (14). The combination of FKP weightings (§§3.10, 
3.11) is such as to optimize the measurement of power along the transverse axis. Thin, medium, and thick contours represent negative, 
positive, and zero values respectively. 



selection make the PSCz the finest publicly available redshift 
survey for this purpose. 

The analysis is described in Sections 2 (linear) and 3 
(nonlinear), and results are presented in Section 4. Section 5 
summarizes the conclusions. Tables of measurements are 
collected in an Appendix, and are also available from http:// 
casa.colorado.edu/~ajsh/pscz/. 



2 ANALYSIS - LINEAR REGIME 

At linear scales, k ^ 0.3/iMpc~^, we adopt the real 
space power spectrum of the PSCz survey measured by 
Hamilton, Tegmark & Padmanabhan (2000, hereafter HTP). 
This measurement assumes that density fluctuations are 
Gaussian, and that redshift distortions conform to the linear 
model (Kaiser 1987). The linear measurement yields three 
separate power spectra, the galaxy-galaxy, galaxy-velocity, 
and velocity-velocity power spectra. In the present paper 
we use only the galaxy-galaxy power spectrum, which is the 
real space power spectrum, redshift distortions having been 
isolated into the other two power spectra. 

The linear measurement can lay claim to being optimal 
when the prior assumptions are true, but it becomes 
suboptimal, and eventually fails, at nonlinear scales. This is 
not merely because the linear model of redshift distortions 
fails, as of course it does, nonlinear redshift distortions 
being dominated by fingers-of-god, not by coherent infall 
toward large scale overdensities. More fundamentally, the 
assumption of Gaussian density fluctuations fails. In 
particular, the linear measurement seriously underestimates 
the variance of power in the nonlinear regime, by a factor 
~ (1 + Oi where ^ is the correlation function. 

Thus an entirely different strategy is called for at 
nonlinear scales. 



3 ANALYSIS - NONLINEAR REGIME 

At nonlinear scales, k ^ 0.3/iMpc~^, a major simplifying 
assumption can be made, that redshift distortions are plane- 



parallel (the 'distant observer' approximation). The plane- 
parallel approximation fails at large scales, so the nonlinear 
method breaks down at linear scales, just as the linear 
method breaks down at nonlinear scales. 



3.1 Real power is transverse power 

In the plane-parallel approximation, the redshift space 
power spectrum P''(k±,kn) (the superscript s denotes 
quantities in redshift space) at wavenumbers k± and 
fc|| perpendicular and parallel to the line-of-sight is the 
Fourier transform of the redshift space correlation function 
^"(rx,?"!]) at redshift separations r± and ry perpendicular 
and parallel to the line-of-sight; 

P'{k^,k^^)= J e'*-L-''-L+"=ni^''(rx,r-||)dV_Ldr|| . (1) 

Redshift distortions affect only separations in the line-of- 
sight direction. Equation (1) shows that the redshift power 
spectrum in the transverse direction, where fc|| = 0, involves 
an integral of the redshift space correlation function over 
the line-of-sight separation ry. Since redshift distortions 
displace galaxies along the line-of-sight, but neither create 
nor destroy them, the integral along the line-of-sight is left 
unchanged by redshift distortions. It follows that the redshift 
space power spectrum in the transverse direction is equal to 
the real space power spectrum 

P''(fcx=fc,fc||=0) =P(fc) . (2) 

Thus the problem of measuring the real space power 
spectrum reduces to that of measuring the redshift space 
power spectrum in the transverse direction. 

Figure 1 shows a contour plot of the redshift space 
power spectrum P''(fcx,fc||) of PSCz. The redshift power 
shown in Figure 1 is measured from the harmonics of the 
redshift space power spectrum, as explained in detail in the 
remainder of this Section. The nonlinear real space power 
spectrum reported in this paper is equal to the redshift space 
power spectrum along the transverse axis in Figure 1. 
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3.2 Information from galaxy redshifts 

Measuring real power from the redshift power at exactly 
/c|l = 0, as specified by equation (2), is liable to lead to a 
rather noisy estimate. A more precise estimate of real power 
could be obtained by 'averaging' (in some sense) the values 
of redshift power in some interval about fey = 0. 

Using redshift power at /c[| ^ is equivalent to 
exploiting information from galaxy redshifts. Suppose that 
velocity dispersion (or perhaps some other influence) causes 
galaxy distances to be known only to an accuracy of a. 
Then the observed redshift power spectrum is the true 
power spectrum multiplied by a window that looks like a 2- 
dimensional sheet transverse to the line-of-sight, a horizontal 
ridge of width Afcy ~ 1/a about k\\ = 0. It follows that 
redshift power within ~ l/cr of fcy = provides potentially 
useful information about real power. 

If redshift information were discarded, then the uncer- 
tainty in galaxy distances would increase to the depth ~ R 
of the survey, and the window through which the power 
spectrum is observed would thin to Afcy ~ 1/R. 

Thus with galaxy redshifts there is ~ R/a times 
as much exploitable fe-space as without. In the PSCz 
survey, the central two quartiles in depth, containing half 
the galaxies, run from 50 to 150/i"^Mpc. The effective 
uncertainty in the distance of a galaxy without a redshift 
can be taken to be half this, R ~ 50/i^^Mpc. The velocity 
dispersion is a ~ 3/i~^Mpc. Thus PSCz with redshifts is in 
a sense comparable to a no-redshift survey some 50/3 ~ 16 
times larger. The errors on the real space power spectrum 
of PSCz with redshifts might be expected to be roughly 
(50/3)^^'^ ~ 4 times smaller than PSCz without redshifts. 
Evidently the gain in having redshift information may be 
considerable. 



3.3 Distance indicator versus true distance 

It is worth pointing out an important distinctive feature of a 

redshift survey versus an angular or photometric survey. In a 
redshift survey, the relation between the distance indicator - 
the redshift distance - and the true distance is independent 
of depth (at least to the extent that cosmological evolution 
of the power spectrum can be neglected). In an angular 
or photometric survey, by contrast, the relation between 
distance indicator - apparent brightness in the angular 
survey, or photometric distance in the photometric survey - 
depends on depth. 

The existence of a well-defined redshift space power 
spectrum P''{k), as in equation (1), depends implicitly on 
the assumption that the relation between redshift distance 
and true distance is independent of depth. 



3.4 Angular mask and selection function 

We adopt the same angular mask and selection function 
as HTP. The angular mask is the high-latitude mask of 
Saunders et al. (2000) (hibpsczmask.dat, part of the PSCz 
package), which leaves unmasked 9.0636 str, or 72% of the 
sky. Measurement of the selection function is discussed 
below in Section 3.12. The angular and radial cuts leave 
12 446 galaxies in the survey. 



3.5 Approximating nonlinear redshift distortions 
by a finite sum of harmonics 

To exploit redshift information to best advantage, it 
is necessary to have some model of nonlinear redshift 
distortions. Since accurate a priori models of nonlinear 
redshift distortions arc not available (Hatton & Cole 1997, 
1999) - especially if nonlinear galaxy-to-mass bias is taken 
into account - we resort to a semi-empirical approach, 
motivated by a combination of theory and observation. Our 
adopted solution is to measure the harmonics of the redshift 
power spectrum, and to assume that nonlinear redshift 
distortions can be approximated by retaining only a finite 
number of harmonics, the number of harmonics retained 
depending on k. The procedure is analogous to the familiar 
one of smoothing an image by eliminating high frequencies 
in Fourier space. 

It is convenient to introduce the function /(fe) defined 
to be the ratio of redshift to real space power spectra (cf 
Landy, Szalay & Broadhurst 1998) 

/W-^. (3) 

By construction, this ratio is unity in directions transverse 
to the linc-of-siglit, f{k±—k,k^^—0) — 1. 

Figure 2 shows a contour plot of the ratio /(fe) measured 
from the PSCz survey. Naturally this plot represents our 
final, best measurement; however, preliminary versions of 
this plot contributed to the decision about the best way 
to measure it. The final version of the plot is consistent 
with the preliminary versions; tweaking caused only minor 
adjustments in the contours, with no significant systematic 
shifts. 

In the linear regime, /(fe) is given by Kaiser's (1987) 
famous formula for plane-parallel redshift distortions 

/(fc) = (l + /3M')' (4) 

where /i = k\\/k is the cosine of the angle between the 
wavcvector fc and the line-of-sight. Here /(fe) is a fourth 
order even polynomial in jj,. 

In Eulerian second order perturbation theory, /(fe) 
becomes an eighth order even polynomial in jj,, with 
coefficients that depend on the absolute value k of the 
wavcnunibcr (Scoccimarro, Couchman & Fricman 1999). 

The precise behaviour of /(fe) in the nonlinear regime 
is unknown. A simple and widely used empirical approxi- 
mation is to assume that the redshift correlation function 
^"(r) equals the real correlation function ^(r) modulated 
by a random pairwise velocity distribution fv{v\\) that is 
independent of pair separation (note that r has units of 
velocity: l/i"^Mpc = 100 kms"^) 

/oo 
?(r±,r|| -?;||)/„(t;||)dv|| . (5) 
-oo 

Most commonly, the 1-dimensional pairwise velocity distri- 
bution fv{v\\) is taken to be an exponential 

/.(t;||) = (2VV)-^xp(-2V>ll|/cr) (6) 

with 1-dinicnsional pairwise velocity dispersion a. The 
exponential pairwise velocity distribution was first proposed 
by Peebles (1976), and has continued to receive support 
from observations (Davis & Peebles 1983, CfAl; Fisher et 
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Figure 2. Contour plot of the ratio f{k) = P" (k) / P{k) of the redshift to real space power spectrum. By construction, the ratio 
f{k) equals one along the horizontal axis, where fcy = 0. The width of the ridge along the horizontal axis is roughly equal to the 
inverse of the pairwise galaxy velocity dispersion, Afcy ~ I/ct. If velocity dispersion were independent of scale, then the contours in this 
diagram would be horizontal. The pairwise velocity dispersion reaches a maximum at fc fa 1.3 /i Mpc~^, where the contours crowd the 
horizontal axis most closely. Medium and thick contours represent positive and zero values respectively. The white space to the top left 
of the diagram appears because the line-of-sight wavenumber A;|| (the vertical axis) must be less than or equal to the total wavenumber 
k = (fc^ + fc?)-*^/^ (the horizontal axis); the boundary is shaped exponentially because the plot is linear in fcy but logarithmic in k. 



al. 1994b, 1.2 Jy survey; Marzke et al. 1995, CfA2 + SSRS2; 
Landy, Szalay & Broadhurst 1998, LCRS; Jing, Mo & Borner 
1998, LCRS) from iV-body experiments (Fisher et al. 1994b, 
Fig. 5; Zurek et al. 1994, Fig. 7), and from theoretical 
arguments (Sheth 1996; Diaferio & Geller 1996; Seto & 
Yokoyama 1998; Juszkiewicz, Fisher & Szapudi 1998). 

If the pairwise velocity distribution fv(v\\) were indeed 
independent of scale, then /(fc) in equation (3) would equal 
the 1-dimensional Fourier transform of fv{v\\) 



f{k) = 



(7) 



a function only of fcy = k^. For the exponential pairwise 

velocity distribution, equation (6), /(fc) would be a 
Lorentzian 

1 1 



1+ i((jfc|| 



1 + i(afc/i)2 



(8) 



Equation (8) is a specific example of the general expectation 
that /(fc) in the nonlinear regime should be a smooth 
function, peaked at fc|| = 0, with width Afc|| ~ l/cr. 

Figure 2 shows that in reality the pairwise velocity 
dispersion a is not independent of scale. Rather, the velocity 
dispersion reaches a maximum at fc « 1.3/iMpc~^ (where 
the contours of /(fc) crowd the horizontal axis most closely), 
and decreases to smaller scales (larger k). This decrease 
in velocity dispersion to smaller scales is qualitatively 
(though not necessarily quantitatively) consistent with the 
expectation from the virial theorem that ~ 'r'^S.i'f) ^ 
kP{k) (Davis & Peebles 1977; Peebles 1980, §75), which with 
P{k) 9S k-^-^ (as found in §4) would predict a « fc-°•2^ 

Jing & Borner (2001) find in A'"-body simulations of 
CDM variants that /(fc) falls somewhat faster than the 
Lorentzian model, equation (8), at large akfi. They find that 
a better fit is 



■'^ ' l + i(crfc^i)2+r;(afc^i)4 
with a a function of fc, and rj a fitting parameter. 



(9) 



The above examples suggest the idea of approximating 
/(fc) as an even order polynomial in /i = fcy/fc, or 
equivalently as a finite sum of even harmonics. 



/(fc) 



max(fe) 



(10) 



where VeifJ,) denotes a Legendre polynomial, with maximum 
harmonic i'max(fc) depending on wavenumber fc. Of course 
the Lorentzian example, equation (8), is not a finite poly- 
nomial (nor even a convergent Taylor series, if ^{akfif > 
1); but evidently it could be approximated as such. The 
principal advantages of the description in terms of harmonics 
are (1) its fiexibility, and (2) fitting to a linear combination 
of even harmonics (i.e. a polynomial in fi^) is far easier than 
nonlinear fitting to, for example, a rational function of fi'^ . 

A key question is how many harmonics to include in the 
sum (10). Too many harmonics will yield an unnecessarily 
noisy estimate; too few harmonics will fail to resolve the hill 
at /i = 0, and will tend to bias the measurement low. 

At linear scales, the maximum harmonic should be 
^max(fe) = 4, in accordance with Kaiser's formula (4). 
At nonlinear scales, it is necessary to resolve radial 
wavenumbers comparable to the inverse pairwise velocity 
dispersion, l/cr, in accordance with the arguments in 
Section 3.2. Harmonics up to £ can resolve angles ~ n/i, 
hence radial wavenumbers Afcy ^ kn/i. Thus resolving 
Afc|| ~ 1/(T requires harmonics up to 



(fc) ~ TTCTfc 



(11) 



If the velocity dispersion is (t ~ 3/i~^Mpc, then equa- 
tion (11) suggests ^max ~ 10 at fc l/iMpc~^. The linear 
and nonlinear estimates together thus suggest, provisionally. 



^max(fc) =4 + 6fc 



(12) 



with fc measured in /iMpc~^. 

The maximum harmonic specified by equation (12) 
was our original choice, and we carried out a complete set 
of measurements with it. The preliminary measurements 



© 0000 RAS, MNRAS 000, 000-000 



Real Space Power of PSCz 5 



indicated that redshift power was possibly slightly under- 
resolved at fc ~ l/iMpc~^, but over-resolved at large 
k. This can be seen in Figure 2, which shows that the 
ridge of redshift power along the transverse axis reaches 
its narrowest point at fc ~ 1.3 /i Mpc""*^, where Afcy ~ 
0.33/iMpc~^, but broadens out at larger k. The velocity 
dispersion a ~ 1//S.k\\ is thus comparable to 3/i~^Mpc at 
k ~ l/iMpc~^, but is smaller at large k. Consequently 
the maximum harmonic £max of equation (12), which 
provisionally presumed that a ~ 3ft^^Mpc, is about right 
at A: ^ 1 /iMpc~^ but unnecessarily large at large k. On the 
basis of the preliminary measurements, we revised the choice 
of maximum harmonic to (the nearest even integer to) 



^max(fc) = 16 fc'/' 



(13) 



again with k measured in /iMpc~^. The revised choice 
of maximum harmonic i'max(fc) is slightly larger than the 
provisional choice at ~ l/iMpc~^ (so as to be on the 
safe side), but smaller at large k. The milder increase of 
maximum harmonic with wavenumber, Imax oc k^^'^ instead 
of i'max OC fc of equatiou (12), reflects not only the fact that 
the velocity dispersion cr decreases at larger k, as seen in 
Figure 2, but also that the statistical uncertainties increase 
at larger k. More harmonics means smaller systematic bias, 
but larger statistical uncertainty. The choice (13) is intended 
to make the statistical error as small as possible while 
ensuring that the systematic bias is small compared to the 
statistical error. Note that the nonlinear measurements are 
limited to A; > 0.1 /iMpc~^, and that equation (13) gives 
•^max = 6 at the smallest wavenumber of the nonlinear range, 
k = O.l/iMpc"^ 

Equation (13) is our adopted final choice of maximum 
harmonic ^max(A;). For other reasons, to be discussed in 
Section 3.7, we also limit the maximum harmonic to 



,{k) < 72 . 



(14) 



Numerical experiment, reported in Section 4.3, indicates 
that the maximum harmonic specified by equations (13) 
and (14) is large enough that any bias caused by using 
too few harmonics is small compared to the statistical 
uncertainty. In practice, the measured power spectrum 
proves satisfyingly robust against changes in the choice 
of maximum harmonic, the changes being typically some 
fraction of Icr, and random rather than systematic. 



3.6 Measuring harmonics of band-powers 

We measure harmonics of band-powers of the redshift space 
power spectrum using essentially the same procedure as 
Hamilton (1995, 1998; hereafter H95, H98), which is a 
slightly refined version of the method of Hamilton (1992, 
1993; hereafter H92, H93). 

A feature of this analysis is that, although it is the 
power spectrum that is being measured, all the calculations 
are done in real (redshift) space rather than in Fourier 
space. In measuring redshift distortions, it is important to 
disentangle the true distortion from the artificial distortion 
introduced by a non-uniform survey window. In real 
(redshift) space, the observed galaxy density is the product 
of the true density and the selection function. In Fourier 
(redshift) space, this product becomes a convolution. Thus 



the natural place to 'deconvolve' observations from the 
selection function is real space, where deconvolution reduces 
to division, and where the observations exist in the first 
place. 

Let P/(fc) denote the £'th harmonic of the redshift 
power spectrum folded through some band-power window 
W{k, k) (the tildes distinguish band-powers P" and their 
characteristic wavenumbers k from the raw power spectrum 
P^(fe); tildes are tacitly dropped in the Results Section 4, 
even though the powers reported there are in fact band- 
powers): 



Pi{k)= j W{k,k){2l + l)Vi{ij)P\k)d\/{2-Kf 



(15) 



The band-power windows W{k, k) will be chosen momen- 
tarily (§3.7) to be strictly positive functions narrowly 
peaked about a central wavenumber k, but for the moment 
equation (15) is entirely general. The band-power Pl{k), 
equation (15), can be expressed as an integral over the 
redshift space correlation function (H98, §5.2) 



/ 



P/(fe)= / We{k,r){2£+l)Ve{nr)e{r)d\ 



(16) 



where We{k, r) is a spherical Bessel transform of W{k, k): 



Wt{k,r) 



ji{kr)W(k,k)4nk'^dk/{2nf 



(17) 



Equation (16) is the basic equation that allows galaxy pair 
counts to be converted directly into band-powers. 

The redshift correlation function ^"{rjfir) at separation 
r and cosine angle fir = z.r to the line of sight z is estimated 
by the H93 estimator (the hat on in eq. 18 is a reminder 
that it is an estimate, not the true value) 



i+r(r-,Mr) 



{DD){RR) 



(18) 



where, following the conventional notation of the literature, 
D signifies data, and R signifies random background points 
(although in practice all the background integrals here were 
done as integrals, not as Monte-Carlo integrals). The angle 
brackets () in equation (18) represent FKP-weighted (see 
§3.10) averages over pairs at separation r and fir- The 
line of sight z is defined separately for each pair as the 
angular bisector of the pair. To allow for IRAS's 1'.5 angular 
resolution, only pairs further apart than l!5 arc retained 
(see §4.2 for further discussion of this important effect), and 
to ensure the validity of the plane-parallel approximation, 
ordy pairs closer than 50° on the sky are retained. Poisson 
sampling noise is removed by excluding self-pairs (pairs 
consisting of a galaxy and itself). 

We continue the tradition of H92-H98 in computing 
the angular part of the pair integrals (DR) and (RR) ana- 
lytically (H93, Appendix), which leaves a single numerical 
integral over the radial direction. The procedure is faster and 
more accurate than Monte Carlo methods, and eliminates 
the artificial problem of shot noise in the background counts. 
We also continue the tradition of H92-H98 in explicitly 
subtracting the shot noise contribution to {DR)^ that comes 
from the same galaxy contributing to D in both factors of 
(DR) (§2c of H93), eliminating the small bias that arises if 
that contribution is not subtracted. 
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3.7 Band-power windows 

The resolution Ak witli wliicli tlie power spectrum can be 
measured is limited by the characteristic size R of the survey 
to Afc ~ 1/R. At linear scales this size, and indeed the 
detailed shape of the survey volume, plays an essential role 
in constructing band-power windows, but at nonlinear scales 
there is greater freedom to choose band-power windows more 
arbitrarily. 

Following H95, H98, we adopt band-power windows 



that are power laws times a Gaussian, W 



, suitably 



scaled and normalized (see eq. 19 below). The advantages 
of this choice are: (1) the band-power windows are strictly 
positive, preserving the intrinsic positivity of the power 
spectrum; (2) they vanish at zero wavenumber (provided 
that n > 0), so immunizing the measurement of power 
against uncertainty in the mean density (which makes a 
delta- function contribution to power at zero wavenumber); 
(3) they are analytically convenient; (4) they yield Gaussian 
convergence as a function of pair separation r in the 
corresponding real space windows Wi{k,r), equation (20), 
for harmonics I < n, provided that n is chosen to be an 
even integer. 

Amusingly, a power law times Gaussian, fc"e , is 
the lowest energy eigenstate of a three-dimensional simple 
harmonic oscillator with angular momentum n. Thus there 
is a least-squares sense in which the band-power window 
yields a measurement of the n'th harmonic of the power 
spectrum at the smallest possible wavenumber with the 
smallest possible pair separations (Tegmark 1995). 

As a compromise between resolution and the size of 
error bars (higher resolution means larger error bars), 
we choose band-powers uniformly spaced at A log k = 
1/16, the same resolution adopted by HTP in the linear 
regime. The resolution of the band-power windows fc"e , 
equation (19), increases with the exponent n, the full width 
at half maximum (fwhm) going approximately as A log k 25 

n"^''^. We choose n = 72, which has a fwhm of Alogfc ~ 
1/12, slightly wider than the adopted band-power spacing 
of Alogfc = 1/16. 

The maximum measurable harmonic at n = 72 is ^ = 
72, which explains the limit (14). We also measured band- 
powers with exponents n = 72 x 4 = 288, whose fwhm is 
1/2 that of the n = 72 band-powers, and for n = 72 x 9 
= 648, whose fwhm is 1/3 that of the n — 72 band-powers. 
Since the higher resolution measurements were consistent 
with the lower resolution n = 72 measurement (see §4.5), 
with little sign of any systematic offset caused by insufflcient 
resolution, we choose to report as standard the result from 
the lower resolution n = 72 measurement, which has slightly 
smaller error bars (after the higher resolution measurements 
are rebinned in fc to the lower resolution). 

Suitably scaled, and normalized so J W{k, k) d''fc/(27r)'^ 
= 1, the band-power windows are 



W{k,k) 



[2^ 



2e 



r[(n+3)/2] 



ak 
k 



(19) 



The constant a is chosen so that the band power window 
W{k, k) is centred at fc « fc. Following H95, H98, we choose 
the constant a = {r[(n+3)/2] /r[(n+7)/2]}[^/'^"^'l so that 
the smoothed monopole power at wavenumber fc is equal to 



Pair separation r {h ^Mpc) 
100 30 10 3 1 .3 .1 




.01 .03 .1 .3 13 10 
Wavenumber k {h Mpc~ ' ) 

Figure 3. Band-power windows for k = Ih Mpc~^. The window 
marked k is the scaled band-power window iy(A:,fc)A:3/2/(27r2) 
with n = 72, equation (19), plotted as a function of the 
wavenumber k labelled on the lower axis. The window is scaled 
with fc~^/^47rfe'^/(27r)^ = k? ^ j {2-^^) to reveal more clearly the 
effective shape of the window when a power spectrum oc k~^l'^ 
(as approximately the case in PSCz) is folded through it. The 
plotted scaled window has the property that it yields 1 when 
integrated over either J' d In fc or ^ k^l"^ d In fc. The remaining 
windows, each marked with the associated harmonic number 
are the corresponding windows W^^(fc, r) r^/^ (2/7r)^/^ in real 
space, equation (20), plotted as a function of the separation r 
labelled on the upper axis. Again, each window is scaled with 
(27rr)~'^/^47rr^ = r^/'^(2/-K)^/'^ to reveal more clearly the effective 
shape of the window when a correlation function (27rr)~^/^, 
corresponding to a power spectrum k~^/'^ , is folded through 
it. The plotted scaled windows have the property that they 
yield 1 when integrated over J'dlnr, for all I. Changing the 
characteristic wavenumber k of the band-power shifts all windows 
sideways on this plot, without changing their shape. 



the unsmoothed monopole power at the same wavenumber, 
Pq{^) = ^o'('^)j for the particular case where the power 
spectrum is a power law Po{k) oc k'''~'^ (corresponding to 
^(r) (X r~^) of index 7 — 1.5, that is, for Pq (fc) oc k~^'^ . For 
the case n = 72 in the window (19), this fixes a = 6.051. 

The harmonics Pi{k) of the redshift power spectrum 
folded through the window (19) are, according to equa- 
tion (16), equal to the harmonics of the redshift correlation 
function folded through the corresponding windows We{k, r) 
given by equation (17): 



Wi{k,r) = 



(3/2) 



(n/2) 



-^(n-^)/2V* 



£ (20) 
Za 



(note that Wo{k, 0) = 1) where are Laguerre polynomials 
(Abramowitz & Stegun 1964) and (3/2) („/2) = r[(n+3)/2]/ 
r(3/2) is a Pochhammer symbol. 

Figure 3 illustrates both the Fourier band-power 
window W{k,k), equation (19), and a selection of its real 
space counterparts We{k,r), equation (20), for the case n = 
72. The Figure illustrates that measuring higher harmonics 
of power requires finer resolution in Fourier space, hence 
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Figure 4. The 12 871 galaxies of the PSCz 0.6 Jy survey with the high-latitude angular mask (hibpsczmask.dat in the PSCz package). 
The map is a Hammer-Aitoff projection, in Galactic coordinates, with the Galactic centre at the centre. Larger points signify closer 
galaxies [area oc l/(redshift distance)], as exampled. The inset shows the 22 angular regions used in the error analysis; the boundaries 
of the angular regions are lines of constant ecliptic longitude and latitude. 



wider separations in real space. At small separations r, the 
real space windows We{k, r) alternate between being positive 
or negative, as £/2 is even or odd, thanks to the i' factor in 
equation (20). 

One of the features of the fc"e band-power window 
is that it vanishes at fc = 0. It follows that any constant 
contribution to the correlation function , equivalent 
to a delta-function contribution to power at fc = 0, 
vanishes when folded through the windows We{k, r) given by 
equation (20). Thus in estimating Pi(k) by equation (16), 
the factor in the integrand can be replaced by 1 -I- ; it 
is unnecessary to subtract the 1 part of the estimator 1 + 
of equation (18). 

3.8 Covariance matrix 

Reliable error bars on a measurement are as important as 
the measurement itself. Indeed, if precise comparison to 
theoretical models is to be made, then a full covariance 
matrix is essential (Eisenstein & Zaldarriaga 2001; Tegmark 
et al. 2001). 

There are essentially three ways to determine uncertain- 
ties, differing in how much prior information they invoke. 

The ideal situation is to know a priori what the covari- 
ance matrix is, or to know its form as a function of a modest 
number of parameters. Precisely this situation obtains for 
Gaussian fluctuations in the linear regime. Unfortunately, 
notwithstanding valuable progress (Scoccimarro & Frieman 
1999; Szapudi, Colombi & Bernardeau 1999) the covariance 
matrix of nonlinear power is not accurately known (in either 
real or redshift space), and indeed the simplest model, 
based on the hierarchical model with constant hierarchical 
amplitudes, is known to be inconsistent, because it violates 
the Schwarz inequality (Scoccimarro, Zaldarriaga & Hui 
1999; Hamilton 2000). 

A second commonly used strategy is to estimate the 
covariance from the scatter in measurements from ensembles 
of mock catalogues constructed from iV-body simulations to 
resemble the survey as closely as possible (e.g. Fisher et al. 
1993; Cole et al. 1998). 



A third alternative is to measure the covariance directly 
from the level of fluctuations observed in the survey itself 
(II93; Szapudi 2000), and here we follow this latter approach. 
The approach takes full account of the correlated character 
of the fluctuations in a survey. Although the method is 
expected to break down at scales approaching the size of the 
survey, it should work fine at the nonlinear scales addressed 
here. 

H93's method for measuring covariance works in essence 
as follows (see §4 of II93 for intricate details). Let P 
be a quadratic estimator, some integral of products of 
pairs of galaxy densities. For example, P could be an 
estimate of Pl{k), the I'th harmonic of some band-power 
in redshift space, equation (16). Divide the survey into a 
reasonably large number of subvolumes. Here we choose 22 
angular regions, as shown in the inset to Figure 4, times 
10 radial shells, each 0.2 dex wide, covering radial depths 
from 10° ''25 to 10^'®^^ ft-^Mpc (i.e. 4.2 to 420/i"^Mpc). 
Imagine attaching a weight Wi to each of these 22 x 10 = 
220 subvolumes. As each of these weights is varied, the 
estimated value P changes. Note that the estimator P is 
being supposed subject to an overall normalization condition 
such that it remains an unbiased estimate of the thing being 
estimated, as the weights Wi are varied; in other words, only 
the relative weights Wi really matter. Define the fiuctuation 
APi in P attributable to subvolume i by 

1 dP 

AP = ,:w,^ (21) 

where the important factor 1/2 arises because P depends 
quadratically on galaxy density. Then (H93) the variance of 
P is given by a sum over pairs ij of subvolumes 

(AP^) = AP.APj . (22) 

The fiuctuations AP^ are subject to a 'pair-integral 
constraint' that their sum over all subvolumes should be 
zero, ^ . APi = 0. This follows from the fact that changing 
all the weights Wi by the same constant factor leaves the 
estimate P unchanged. If all pairs ij of subvolumes were 
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included in the sum on the right hand side of equation (22), 
then the variance (AP^) would be zero, because of the 
integral constraint APi = 0. Consider instead including 
in the sum only pairs ij of subvolumes closer than some given 
separation. Characteristically, as this maximum separation 
between subvolumes increases, the sum on the right hand 
side of equation (22) increases, reaches a maximum, and 
then declines to exactly zero when all pairs of subvolumes 
are included. We follow H93's proposal of approximating 
the variance (AP2) by its maxiirmm value attained as the 
maximum separation between subvolumes is increased. This 
approximation reflects on the one hand the idea that it is 
nearby regions that arc most correlated, and on the other 
hand the desire to include as much of the correlation between 
nearby regions as possible. 

As discussed by H93, the pair-integral constraint means 
that the variance (AP^) is inevitably underestimated at 
scales approaching the size of the survey. However, this 
effect should be minor at the nonlinear scales addressed here. 
Conversely, there may be some tendency to overestimate the 
variance because noise is liable to mate the measured max- 
imum in the variance fluctuate above the true maximum. 

The covariancc between P and another any quadratic 
estimator P' is given by a generalization of equation (22), 



(APAP'> = ^ APiAPj . 



(23) 



Again, if all pairs ij of subvolumes were included in the 
sum on the right hand side of equation (23), then the 
covariance would be zero, because of the integral constraint 

y^ ^. APi = 0. In this case the strategy of approximating 
the covariance by the maximum value attained, as pairs ij 
of greater and greater separation are included in the sum, 
fails. The strategy fails partly because covariances need not 
be positive, and partly because choosing covariances to be 
large is not necessarily a conservative approach - whereas 
increasing variances always reduces information content, 
increasing covariances can actually increase information 
content, because two highly correlated quantities contain 
information about each other. 

Here we estimate the covariancc (APAP') as the 
average of the sums ApAPj evaluated at the two 

places where the variances . APf and . APp reach 
a maximum. 



3.9 Prewhitened power 

The term 'prewhitoning' comes from signal-processing, and 
refers to the operation of transforming a signal in such a 
way that the noise becomes white, or constant (Blackman 
& Tukey 1959, §11). The notion of prewhitening the power 
spectrum of galaxies as a means of narrowing the covariance 
of estimates of power at nonlinear scales was proposed 
by Hamilton (2000, hereafter HOO). Whereas at linear 
scales the covariance of estimates of power is (nearly) 
diagonal, at nonlinear scales the covariance of estimates of 
power is broadly correlated over different wavenumbers, as 
emphasized by Meiksin & White (1999) and Scoccimarro, 
Zaldaxriaga & Hui (1999), and £is illustrated in Section 4.7 
of the present paper. 

HOO showed empirically that prewhitening the power 



spectrum narrowed the covariance of power in a broad range 
of models. As will be seen in Section 4.7, the measured 
covariance of prewhitened power in PSCz is indeed narrower 
than the covariance of power itself. 

The prewhitened power spectrum is defined to be 
the Fourier transform, X{k) = e''' '' X{r) d^r, of the 
prewhitened correlation function X{r) defined by (HOO, 
§5.1) 



l + [l + C('r)]i/2 • 
Differentiating equation (24) gives, to lowest order, 

Mir) 



AX{r) 



[l + C(r)]V2 



(24) 



(25 



so that the covariance of estimates X{r) of the prewhitened 
correlation function is (for small errors) 

{AX{r)AX{r')) 

= [1 + ar)]-'^^{M{r)Aar'))[l + ar'T'^' (26) 

(note that {(,{r)) — (,{r), if ^(r) is an unbiased estimator). 
Since the shot noise contribution to (A^(r) A^(r')), i.e. 
the contribution that comes firom the covariance between 
a pair of galaxies and itself, is in real space a diagonal 
matrix proportional to 1 -|- ^(r) (HOO, eq. 38), it follows 
that the prewhitened covariance, equation (26), has the 
property that the shot noise contribution to {AX{r)AX{r')) 
is proportional to the unit matrix. 

The covariance of estimates AX{k) of prewhitened 
power is given by the Fourier transform of equation (26), 



{AX(k)AX{k')) = H-i/''{AP(fc)AP(fc'))H-i/^ 



(27) 



where H is the Fourier transform of the matrix which in 

real space is diagonal with diagonal entries 1 + ^(r). The 
shot noise (self-pair) contribution to (AX(fc) AX(fc')) is 
again proportional to the unit matrix, since the unit matrix 
remains the unit matrix in any representation. 

Some numerical issues concerning prewhitening are 
discussed in §4.2 of HOO, and as an aid to the reader. 
Appendix A contains practical instructions on how to 
prewhiten a power spectrum numerically. 

One slightly subtle issue is that the power spectrum 
is estimated in discrete band-powers, not as a continuous 
function of wavcnumbcr. Our policy is to adhere to the 
definition (24) of the prewhitened correlation function 



Xir): 



2e(r) 



(28) 



with ^(r) in both numerator and denominator being 
understood to be band-estimates, Fourier transforms of the 
band-powers. 

3.10 FKP weightings 

In a seminal paper, Fcldman, Kaiser & Peacock (1994, 
hereafter FKP) showed that at wavelengths large enough 
to be Gaussian, but still small compared to the scale of the 
survey, the optimal weighting of pairs ij of volume elements 
for measuring the power spectrum P(fc) at wavenumber k is 



"(■'•<)"(■' J ) 



[l + n{ri)P{k)][l + n{rj)P{k)] 



(29) 
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The FKP weighting goes over to equal weighting of volumes 
where the selection function n{r) is large, and equal 
weighting of galaxies where the selection function is small, 
which makes physical sense. 

The FKP weighting is often referred to as 'minimum 
variance' (or more cautiously, 'near minimum variance'), yet 
the range of scales over which it is strictly valid is limited 
(even non-existent). Of course it is commonly, and correctly, 
argued in defense of the more general use of the FKP 
weighting that because the variance changes quadratically 
about its minimum, a near minimum variance weighting 
should give a result not much worse than the true minimum 
variance. 

The simplicity of the FKP weighting, equation (29), 
springs from the fact that, for Gaussian fluctuations, the 
covariance matrix (AP(fe)AP(fc')) of estimates of power 
(including the shot noise contribution) is diagonal (for 
Gaussian fluctuations, at wavelengths small compared to the 
survey). Thus the inverse covariance matrix, which deter- 
mines the optimal weighting of pairs, is similarly diagonal. 
The eigenvalues of the inverse covariance constitute the 
FKP weights, equation (29). By contrast, the covariance of 
estimates of the correlation function ^(r), for example, is 
not diagonal, and the optimal weighting of pairs is, strictly, 
a complicated matrix. 

At nonlinear scales the covariance of power ceases to 
be diagonal, and the FKP weighting ceases to be optimal. 
However, HOO showed that a weighting similar to the FKP 
weighting is valid for the prewhitened power spectrum (§3.9) 
to the extent that the covariance of prewhitened power is 
indeed (nearly) diagonal. The more general weighting differs 
from FKP in that P{k) in the denominator of the weighting 
is replaced by an 'FKP constant' J, whose value is model- 
dependent, but of order ^ 1-3 times the (unprewhitened) 
power P{k) (HOO, Fig. 11): 



n{ri)n{rj) 



(30) 



[\+n{ri)J][\ + n{rj)J] ' 

The strategy of the present paper is to measure band- 
powers using FKP weightings, equation (30), with 5 values 
of the FKP constant, J = 0, 10, 10^ IQp , and lO" /l"'^Mpc^ 
and then (cautiously) compress (§3.11) the 5 meEisurements 
into a single best estimate of the band-power. 

In accordance with the above arguments, we compress 
not the band-powers themselves, but rather the prewhitened 
band-powers. In other words, to form the best estimate of 
the band-power, we first first prewhiten (§3.9) the 5 FKP- 
weighted estimates, which we then combine into a best 
estimate of prewhitened power, which wo then unprewhiton. 

Why choose 5 particular values of the FKP constant, 
rather than follow HOO and adopt, at each wavenumber 
fe, a single FKP constant J equal to 1-3 times the power 
P{k)? The reasons are both practical and philosophical. 
The practical reason is as follows. We wish to make an 
estimate of the prewhitened power in which the estimate 
^(r) in the denominator of equation (28) is the same as 
the ^(r) in the numerator, at every separation r. But the 
best choice of FKP constant J varies with k, which heis the 
consequence that the best estimate of prewhitened power 
involves estimates of (unprewhitened) power at many J's. 
An alternative procedure that naturally suggests itself might 
be to measure the power spectrum with a fixed J, prewhiten 



it, and call that the best estimate of prewhitened power 
at a particular k. However, the prewhitened power from 
the latter procedure does not satisfy the desideratum that 
the estimates ^(r) in the numerator and denominator of 
equation (28) are the same. Our view is that it is better 
to impose the a priori requirement that the ^(r) in the 
numerator and denominator be the same, than to discard 
that information. Given that it is necessary to measure 
the (unprewhitened) power P(k) at many J's, for each 
wavenumber k, one is also faced with the necessity of 
measuring the covariances between powers with different J's 
and different fc's. But limitations of computer power then 
constrain one to using just a handful of J's. This is the 
practical reason behind the procedure adopted here. 

The philosophical reason for measuring the power by 
compressing estimates from a handful of J's, rather than 
adopting at each k a single FKP constant J equal to 1- 
3 times the power P{k), is that the factor of 1-3 depends 
on the assumed model for the behaviour of higher order 
correlations, and there is no assurance that the PSCz 
data conform to the model. Indeed the model adopted by 
HOO — the hierarchical model with constant hierarchical 
amplitudes — is certainly wrong at some level, because the 
resulting covariances of power violate the Schwarz inequality 
unless the 4-point star amplitude is equal to minus the 4- 
point snake amplitude, Rb = —Ra, contrary to observation 
(Scoccimarro, Zaldarriaga & Hui 1999 §3.3; HOO). Our 
preference is therefore to allow the PSCz data to 'choose' 
the best weighting. 

3.11 Cautious Fisher compression 

At this point, the data consist of 5 FKP weightings of 
each of 37 harmonics (even harmonics up to £max = 72) 
of band-powers at each of 57 wavenumbers (fc = 0.1 to 
316ftMpc~^ logarithmically spaced at Alogfc = 1/16), a 
total of 5 X 37 X 57 = 10 545 quantities. Along with the 
data are their fluctuations, equation (21), with respect to 
each of 220 volume elements, a total of 10 545 x 220 = 
2 319 900 fluctuations. The 10 545 x 10 545 covariance matrix 
of the data is constructed (or at least constructible) from 
the fluctuations as described in Section 3.8 (in effect, the 
fluctuations provide a convenient way to store in abbreviated 
form the variances and covariances between all 10 545 
quantities). 

In principle, the Fisher matrix formalism (see Tegmark, 
Taylor & Heavens 1997 for a review) allows one to take 
the 10 545 data and use their Fisher matrix - their 
inverse covariance - to compress them optimally into 57 
measurements of real space power. Unfortunately, errors 
in the measured covariance matrix thwart so idealistic an 
enterprise. We relegate this moral tale of failed ambition to 
its rightful place, an Appendix. 

A symptom of the difficulty with the covariance matrix 
is that a good fraction of its eigenvalues are negative, 
whereas in reality the covariance matrix should be positive 
definite, with all positive eigenvalues. 

If the only problem were negative eigenvalues, then it 
would be easy to solve by Singular Value Decomposition. 
The more serious problem is that the covariance matrix 
contains positive eigenvalues some of which are evidently 
spuriously small. A small positive eigenvalue can signify 



© 0000 RAS, MNRAS 000, 000-000 



10 A. J. S. Hamilton and M. Tegmark 



either that a quantity is accurately measured, or else that 
there is some highly correlated set of quantities. Clearly one 
wants to retain a well-measured quantity; on the other hand 
one might be inclined to discard some component of a set of 
highly correlated quantities. 

The problem is not that the covariance matrix is 
particularly badly measured. In fact the level of fluctuations 
in the measured covariances, such as can be seen in 
Figure 15, suggests that the covariances are typically 
accurate- to ^ 20%. Moreover there is general consistency 
with errors measured (HTP) by the linear method. 

Abandoning any grand compression scheme (Ap- 
pendix B), we revert to a simpler program, to compress the 
5 FKP-weiglited estimates of each band-power into one. 

We first form an estimate P{k) of the real space power 
at each FKP weighting and each wavenumber from the 
redshift space power in the transverse direction, jj, = 0, 
including only harmonics of redshift power up to i?max(fc) 
given by equations (13) and (14) (the hat on -P/(fc) in the 
following equation is a reminder that it is an estimate, not 
the true value, of the band-power harmonic P/(fe), eq. 15): 

P{k) = P!{k)Ve{l^=0) . (31) 

e=o 

We compute the 5x5 covariance matrix of the five FKP- 
wciglited estimates P{k) from the fluctuations AP(fe), 
equation (21), as described in Section 3.8. The resulting 
covariance matrix is consistent with that computed less di- 
rectly (hence presumably less accurately) via the covariance 
matrix of harmonics. 

We then prewhiten (§3.9) each of the 5 FKP-weighted 
estimates P{k), and prewhiten their covariance matrix 
correspondingly. Since prewhitening requires knowledge of 
the full power spectrum, we start by compressing the 5 
estimates without prewhitening, derive the best estimate 
power, use that to prewhiten, rederive the best estimate 
power, and iterate to convergence. If Xi denotes the i'th 
of 5 estimates of prewhitened power, then the overall best 
estimate X is that which minimizes 

= (32) 

where Cij = (AXiAXj) is the 5x5 covariance matrix of 
estimates of prewhitened power. The minimum solution 
of equation (32) is 

X = J2y^ai, Wi = . (33) 

Typically, the covariance matrix dj contains some 
small (sometimes negative) eigenvalues, indicating that the 
5 estimates are highly correlated - not a particularly sur- 
prising result. However, minimization typically responds 
to the high correlation by assigning one estimate a large 
positive weight, and another an almost cancelling large 
negative weight. Such behaviour is clearly spurious, an 
artefact of errors in the covariance matrix having random 
ill effects on small eigenvalues. 

We solve the problem by requiring that the weights that 
go into the best estimate, equation (33), all be positive, Wi > 
0. We do this in a dumb way: we flnd the minimum x^ 



solution for each of the 2^ — 1 = 31 nontrivial ways in which 
each of the 5 weights is free or fixed at 0, and choose that 
positive weighting that has the smallest x^- Typically two 
or three of the 5 estimates have nonzero weights in the best 
estimate. The other estimates, having zero weight, are in 
effect discarded, the least informative way of using those 
data. 

The weightings for the full set of band-powers show 
a plausible and expected pattern. Band-powers at larger 

scales, where P{k) is large, prefer weightings with larger 
FKP constants J, while band-powers at smaller scales prefer 
smaller J. 

Finally, having obtained the best estimate prewhitened 
power X, we unprewhiten to obtain the best estimate power 
P. As commented above, several iterations are needed to 
ensure that the power spectrum used in (un)prewhitening is 
the same as the best estimate. 

The main effect of prewhitening before compressing, as 
opposed to compressing powers directly, is to prefer smaller 
FKP constants J. The consequences of this preference are 
commented on in Section 4.5. 

3.12 Selection function 

Since HTP give only a brief description of the 

measurement of the selection function, we offer more details 
here. We adopt three simplifying assumptions commonly 
made in measuring the selection function of a flux-limited 
galaxy survey (see e.g. the reviews by Binggeli, Sandage & 
Tammann 1988; Willmer 1997; Tresse 1999): (1) that the 
luminosity function is independent of position; (2) that the 
survey is complete to the specified fiux limit; and (3) that 
distances and galaxy fluxes are measured with negligible 
error. Undoubtedly all of these assumptions fail at some 
level. 

If the above three assumptions are taken to be 
true, then there is a unique exact solution (modulo an 
overall normalization factor), a solution for the luminosity 
function and radial density distribution of galaxies that 
exactly reproduces the observed distribution of luminosities 
and distances. The exact solution is given by Lynden- 
Bell's (1971) C~ method, which coincides with Turner's 
(1979) method in the limit of infinitesimal bins, and with 
Efstathiou, Ellis & Peterson's (1988) Stepwise Maximum 
Likelihood method in the limit of infinitesimal steps. The 
exact solution is a sum of delta-functions: the luminosity 
function is a sum of delta-functions at the observed 
luminosities of the galaxies; and the galaxy density is a 
sum of delta-functions at the observed distances of the 
galaxies. This is perhaps not too surprising given that 
the observations - galaxies - are themselves described as 
delta-functions in luminosity and distance. The resulting 
selection function, the integral of the luminosity function, is 
a step-function, with a step at the limiting distance of each 
galaxy in the survey. In practice we evaluate the selection 
function using Turner's (1979) method adapted to the ease 
of infinitesimal bins; the algorithm has the merit of being 
exceedingly fast. 

Figure 5 shows the resulting exact solution for the 
selection function and the inferred galaxy density. 

The selection function so computed is 'exact' only to 
the extent that the prior assumptions are valid. Clearly, 
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Figure 5. (Upper panel) Selection function of the PSCz 0.6 Jy 
survey as a function of comoving depth r. The selection function 
is multiplied by in order to reduce its range and hence to 
bring out more detail. The thin solid line is the 'exact' selection 
function, from Lynden-Bell's (1971) method; the upper solid 
line assumes that galaxies evolve with luminosity oc (1 + z)^ *, 
while the lower solid line assumes no luminosity evolution. The 
'exact' selection function is actually a step function with a step 
at the limiting distance of each galaxy, but the steps are so fine 
(there are 12 867 of them) that the lines look almost continuous. 
The dashed line is the smooth analytic fit to the selection function 
with evolution, equation (34), adopted by HTP and here. The fit 
lies almost on top of the 'exact' solution. For comparison, the 
dotted line is the fit suggested by Saunders et al. (2000). (Lower 
panel) Ratio of the observed galaxy number density to the fitted 
selection function at radial depth r in the PSCz survey, averaged 
in depth bins 0.025 dex wide (this plot appears also in HTP). 
The lower line assumes that galaxies evolve with luminosity 
oc (1+2)3 '*, while the upper line assumes no luminosity evolution. 
The dotted line corresponds to the fit suggested by Saunders et al. 
(2000). The unshaded region from radial depth 10° ®25 /i-^Mpc ^ 
4.2/i-lMpc to lO^ ''^^ h-lMpc 420/i-iMpc is the region 
retained for analysis in this paper. 



the 'exact' selection function, being a step-function, does 
not incorporate the Bayesian prejudice that the selection 
function is likely to be smooth. For this reason it is usual to 
fit the selection function to a smooth analytic function. We 
use the maximum likelihood method of Sandage, Tammann 
& Yahil (1979), and fit the selection function n(r) to a 
function whose form is inspired by the Schechter (1976) 



function, but with enough free parameters to yield a good 
fit, also shown in Figure 5: 

logio("-) = - 0-646 logi(,(r-ioo) 

_ 1.86 + 1.836 rioo + 0.3811 4,o + 0.02074 rjpo 

1 + 0.2073 rioo + 0.08386 r^^^ ^ ' 

where rioo is the comoving depth in units of 100ft~^Mpc. 
The assumed redshift-distance relation is that of a flat 
ACDM model with fim = 0.3, JIa = 0.7, in which comoving 
distance r (in velocity units) is related to redshift z by 

^ = 1/6 1/3 ("a(^)' V6, 1/3) - B (Oa, 1/6, 1/3)] (35) 

where c is the speed of light, B{x,a,b) = t'^'^{l — t)''^^ dt 
is the incomplete Beta function, and ^h{z) = + 
^111(1 + zY] is the density of vacuum energy as a function of 
redshift. 

Measurement of the selection function as described 
above determines its shape, but not the overall normaliza- 
tion (Binggeli, Sandage & Tammann 1988). The normaliza- 
tion factor is measured here as one of the parameters of 
the linear method of HTP. The fitting function (34) is thus 
maximum likelihood not only with respect to the shape, 
but also with respect to the normalization. The measured 
normalization depends mainly on the amplitude of the 'mean 
mode' (the mode whose angular shape is the cut monopole, 
and whose radial shape is that of the selection function), 
but it self-consistently incorporates information from the 
amplitudes of all other linear modes. 

A difficulty one encounters in implementing a maximum 
likelihood fit to the selection function, per Sandage et al. 
(1979), is that there are many spurious non-smooth solutions 
that wiggle fiercely and look awful, but nevertheless have 
formally greater likelihood than the desired smooth solu- 
tions. This strange behaviour can be traced to the fact that 
the 'exact' solution for the luminosity function and galaxy 
density is a sum of delta- functions. Formally, the 'exact' 
step-function solution has infinitely greater likelihood than 
any smooth solution. Increasing the number of parameters in 
the fitting function increases the tendency for the maximum 
likelihood solution to slide off into a spurious non-smooth 
solution. To reduce this instability, we start by carrying out 
a simplified least squares fit to the 'exact' selection function, 
since least squares quickly finds an approximate fit without 
serious problems of stability. The resulting approximate 
values of the parameters of the fit provide the starting point 
from which to search for the maximum likelihood solution. 
Even so, the maximum likelihood fitting becomes unstable 
with too many parameters. The adopted fit (34) contains 
7 free parameters, and formally all of these are significant; 
for example, increasing the number of parameters from 5 to 
7 increases the log-likelihood by A In £ = 7. However, we 
could not increase the number of parameters beyond this 
without the solution veering into instability. We interpret 
this behaviour as suggesting that, among functions of its 
form, equation (34) almost exhausts the possibilities for 
finding a better smooth fit. 

As found by Saunders et al. (1990) in the case of the 
QDOT survey (the l-in-6 precursor to PSCz), measurement 
of the selection function yields evidence for what appears 
to be strong evolution, in the sense that galaxies used 
to be more numerous, or more luminous, than they are 
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now. We choose to model evolution by pure luminosity 
evolution, which is mathematically indistinguishable from 
a spectral /sT-correction. Specifically, we adopt a luminosity- 
cum-spectral correction of the form K = (1 + z)" in the 
relation F — KL/[4,-k{1 + z^r^] between the observed flux 
F, luminosity L, redshift z, and comoving distance r of 
a galaxy. Figure 5 shows the observed number density of 
galaxies, divided by the measured selection function, both 
with evolution, k = 3.4, and without, k = 0. The Figure 
shows that, in the absence of an evolutionary correction, 
the galaxy density appears to increase substantially with 
redshift. The large degree of evolution is consistent with that 
reported in QDOT by Saunders ct al. (1990). Actually, a 
canonical IRAS galaxy spectrum dL/dv oc i/^^ (Saunders et 
al. 1990) would predict a spectral /f-corrcction with k = —1. 
In that case, the actual luminosity evolution would be one 
power steeper than indicated in Figure 5. 

The best flt value of the evolutionary exponent k 
increases systematically as the flux limit is decreased, from 
1 at 1.2 Jy, to 2.9 at 0.75 Jy, to 3.4 at 0.60 Jy. This suggests 
the possibility that at least part of the effect may be caused 
not by evolution, but rather by Malmquist bias, in which 
the increasing rmmbcr of galaxies at fainter fluxes, combined 
with random flux errors at the flux limit of the survey, cause 
galaxies to fluctuate preferentially into rather than out of 
the survey. Malmquist bias is expected to be most marked 
in more distant regions of the survey, where the selection 
function is steepest. 

Since galaxies which randomly fluctuate into the sample 
should be clustered in the same way as galaxies which 
correctly belong to the sample, Malmquist bias should not 
bias measurement of the power spectrum, so long as the 
bias is homogeneous over the sky. As discussed in §4.4 of 
Saunders et al. (2000), Malmquist bias in the PSCz survey 
is probably inhomogeneous at some level, notably because 
flux errors are higher in the 2HCON regions of the survey 
than in the 3HCON regions. However, if inhomogeneous 
Malmquist bias were important, then it should show up as 
an excess of angular power over radial power at the largest 
scales. The investigations of HTP reveal no strong excess 
of angular power at large scales in the redshift distortions 
either of the correlation function. Fig. 2 of HTP, or of the 
power spectrum. Fig. 4 of HTP. We tentatively conclude 
that inhomogeneous Malmquist bias is not a major problem 
in the PSCz survey. 

Besides evolution. Figure 5 also suggests growing in- 
completeness at the greatest depths. This may be presumed 
to be the incompleteness at high redshift described in §4.2 
of Saunders et al. (2000), associated with the policy not 
to pursue redsliifts of galaxies optically fainter than h,j = 
19.5™. Since this incompleteness is greater in regions of 
higher optical extinction, and is systematic rather than 
random over the sky (Fig 4. of Saunders et al. 2000), we 
choose to cut the survey at lo2-625 /j-iMpc ^ 420/i"^Mpc, 
as previously did HTP. But whereas HTP set the lower 
depth limit at l/i~^Mpc, here we choose the slightly more 
conservative lower limit of 10°"^'^ /i"^Mpc « 4.2/i"^Mpc, 
about a correlation length, to reduce 'local bias' resulting 
from the fact that we, sitting in a galaxy, the Milky Way, 
are not at a random location. 

The angular and radial cuts leave 12 446 galaxies (out 
of an original 14 677 galaxies with redshifts) in the survey. 



4 RESULTS 

4.1 Real space power spectrum 

Figure 6 shows the real space power spectrum of the PSCz 
0.6 Jy survey with the high-latitude angular mask. The 
values at linear scales are from HTP, while those at nonlinear 
scales are measured as described in Section 3. The plotted 
values are tabulated in Tables Bl and B2. 

At linear scales Figure 6 shows both correlated and 
decorrelated power spectra, as measured by HTP, tabulated 
separately in Tables Bl and B2. The correlated power 
spectrum is the one that emerges most directly from 
the data, and in essence represents the power spectrum 
smoothed through the Fourier transform of the optimally 
weighted survey window. The errors in the correlated power 
spectrum are correlated. The decorrelated power spectrum 
is partially deconvolved in such a way that estimates of 
power at different wavenumbers are uncorrelated with each 
other (Hamilton & Tegmark 2000). The decorrelated power 
spectrum is to be preferred, if one wants to compare a model 
power spectrum to the PSCz data at linear scales. 

At nonlinear scales the power spectrum cannot be 
decorrelated sensibly (unless it is first prewhitened - see 
§4.7) so Table B2 lists the decorrelated power only at 
linear scales. If one attempted to decorrelate the nonlinear 
power spectrum into a set of uncorrelated band-powers, then 
the band-power windows would be so broad, with almost 
cancelling positive and negative parts, that it would be 
hard to interpret the band-powers as representing the power 
spectrum in any meaningful way. 

Integration over the (decorrelated) power spectrum 
yields an rms fluctuation 

in r = 8 h~^Mpc radius spheres of 

0-8 = 0.80 ± 0.05 . (37) 

Figure 6 also shows the concordance model power 
spectrum of Tegmark et al. (2001), nonlinearly evolved 
by the method of Peacock & Dodds (1996). Although the 
concordance model fits well at linear scales, it evidently fails 
dismally at nonlinear scales. 

In fact all Dark Matter (DM) models with constant 
galax;y-to-mass bias - to be precise, all DM models in the 
Eisenstein & Hu (1998, 1999) suites, nonlinearly evolved 
by the method of Peacock & Dodds (1996), and all the 
Cold-I-Hot DM models of Ma (1998a,b), all arbitrarily 
normalized - fail at nonlinear scales, with high confidence. 

The concordance model illustrated in Figure 6 shows 
two characteristic features of all DM power spectra: an 
infiection (Gaztanaga &: Juszkiewicz 2001) at the linear- 
nonlinear transition scale (here k ^ 0.3/iMpc~^), and a 
turnover at the transition between the nonlinear collapse 
and virialized regimes (in the model at fc ~ 3/iMpc~^). 
Instead, the observed PSCz power spectrum shows a near 
power law behaviour P{k) ^ k^^''' over virtually the entire 
observed range. The power law is not exact: visually there 
appears to be a mild upward curvature of power in the 
broad vicinity of A; ~ 2 /iMpc~^. But there is no prominent 
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Figure 6. Real space galaxy-galaxy power spectrum measured from the PSCz 0.6 Jy survey with the high latitude angular mask. To the 
left of the vertical dashed line is the linear measurement from Hamilton et al. (2000), while to the right is the nonlinear measurement 
from the present paper. The solid line is the correlated power spectrum. In the linear regime (left of the vertical dashed line), the 
shaded region is the Itr uncertainty in the correlated power spectrum, and points with error bars constitute the decorrelated power 
spectrum (Hamilton & Tegmark 2000). Each point of the decorrelated linear power spectrum is uncorrelated with all other points. It 
is not possible to decorrelate the nonlinear power spectrum, so in the nonlinear regime (right of the vertical dashed line), points with 
error bars are the errors in the correlated power spectrum. The dashed lines are the flat ACDM concordance model power spectrum 
from Tegmark et al. (2001), with parameters as indicated. The lower dashed line is the linear model power spectrum, the upper dashed 
line the model power spectrum nonlinearly evolved according to the prescription of Peacock & Dodds (1996). 



nonlinear inflection, as there is in APM (Gaztanaga & 
Baugh 1998; Gaztanaga & Juszkiewicz 2001). 

These conclusions are essentially the same as those 
previously arrived at by Peacock (1997) and Jenkins et al. 
(1998). 

While the disagreement between theory and observation 
may presage a drastic failure of DM models, or of the 
Peacock-Dodds or Ma transformations, it seems more likely 
that scale-dependent galaxy-to-mass bias is responsible. 

To make theory and observation agree requires antibias 
at intermediate scales, and positive bias at small scales, as 
can be seen in Figure 6. Remarkably, precisely this type 
of behaviour is reproduced in some A''-body experiments 
(Kravtsov & Klypin 1999; Colm et al. 1999; Benson et 
al. 2000), and there is already vigorous theoretical effort 
to understand it in terms of the way galaxies populate 
dark matter haloes (Ma & Fry 2000a,b; Seljak 2000, 2001; 
Peacock and Smith 2000; Scoccimarro et al. 2001). 

We admit some frustration over our failure, documented 
in Section 3.11 and Appendix B, to measure a positive 



definite covariance matrix for the nonlinear power spectrum. 
Without such a matrix, and given the broad covariance of 
power in the nonlinear regime, it is impossible to assess 
rigorously the statistical significance of the tentative mild 
upward curvature of power near k ~ 2/iMpc~^. If the 
off-diagonal elements of the covariance matrix are simply 
discarded - an inadmissible procedure, but no better option 
presents itself - then the best single power law fit over 
the range k = 0.05-300 ^ Mpc~^ is (with k measured in 
/iMpc"^) 

P{k) ^ f50 fc"^"'^ h'^Mpc^ (38) 

with ~ 25 for 59 nominal degrees of freedom. The low 
per degree of freedom is indicative of the high degree of 
correlation of the nonlinear estimates of power, not of the 
excellence of the fit. The best fit to a sum of two power laws 
over k = 0.05-300 /iMpc~^ is (with k measured in /iMpc~^) 

P{k) ^ (72 fc"^ '^^ + 74 fc"^-^**) /i^^Mpc^ (39) 
with = 19 57 nominal degrees of freedom. The 
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Figure 7. The distribution of the 446 distinct pairs closer than 
10' on the sky, relative to a frame aligned with local ecliptic 
coordinates A,/3 whose origin is the barycenter of each pair. 
Ecliptic north is up, ecliptic east to the left. The distribution 
has parity symmetry through the origin (equivalently, it has 
180° rotation symmetry about the origin). The rectangle at the 
centre illustrates IRAS^s 1.'5 in-scan X 4f75 cross-scan beam. The 
effective angular resolution is higher, particularly in the cross-scan 
(horizontal) direction, thanks to the PSC strategy of combining 
several scans at neighbouring longitudes. Bear in mind that pairs 
are correlated with each other, so that the distribution about the 
origin is not completely random. 

reduction of by 6 for 2 additional parameters can by no 
means be construed as implying that the upward curvature 
of power is statistically significant; but there is a possibility 
that it may be statistically significant. The exponents —1.72 
and —1.28 in the two power law fit, equation (39), may 
exaggerate slightly the asymptotic slopes of the power 
spectrum at large and small scales: the best fitting exponents 
to single power laws at large, k = 0.05-2 h Mpc~^ , and small, 
k = 2-300 /i Mpc~^, scales are —1.53 and —1.37 respectively. 

4.2 Power at the smallest scales 

How reliable are the measurements of power at the smallest 
scales, k ~ 300/iMpc~^? Such scales correspond to 
separations of the order of a galaxy size, Tr/k ~ 10/i~^kpc. 

Beyond the minimum depth of lO^ '^^^ ft-^Mpc ^ 
4.2/i~^Mpc considered in this paper, there are 7 distinct 
pairs of galaxies with transverse separations closer than 
10 h~^kpc (and redshift separations small enough that they 
are probably physically associated) , mostly near the plane of 
the Local Supercluster. There are a further 34 distinct pairs 
with transverse separations in the interval 10-30 ft" ^kpc, 
variously distributed over the sky (3 of the 34 pairs actually 
live in 3 distinct triple systems). The number of close 
pairs, though not large, appears to be enough to provide 
a statistically significant sample. 

An important systematic effect arises from IRAS's 
~ 1.'5 angular resolution, which is expected to lead to 
a deficiency of galaxy pairs at small angular separations. 
IRAS scanned roughly along lines of constant ecliptic 
longitude (see e.g. http://www.ipac.caltech.edu/Outreach/ 
Gallery/IRAS/allsky.html), and the angular resolution for a 
single scan was typically ~ 1^5 in-scan by ~ 4^75 cross-scan 
(§2.3 of Saunders et al. 2000). As described in the IRAS 




Wavenumber A: (/iMpc ') 



Figure 8. IRAS's 1.'5 angular resolution leads to a deficiency of 
pairs closer than If 5 on the sky. Points with error bars constitute 
the standard power spectrum from Figure 6, which takes this 
effect into account. The solid line shows how the power spectrum 
is systematically depressed on the smallest scales if the exclusion 
of close pairs is not taken into account. 



Explanatory Supplement (Beichman et al. 1988, §V.H), the 
resolution of the Point Source Catalog (PSC) was improved 
by combining several scans at neighbouring longitudes. The 
selection rules for the PSC impose an absolute lower limit 
on pair separation of 0.'5 in-scan by 1.'5 cross-scan, although 
this limit is occasionally violated because of variations in 
processing. In the PSCz sample considered in this paper, 
there are in practice 5 distinct pairs closer than 1.'5, though 
none closer than 0!75. 

Figure 7 shows the distribution of close pairs relative to 
a frame aligned with local ecliptic coordinates. The Figure 
shows that the effective resolution in the cross-scan direction 
is substantially higher than the 4!75 single-beam resolution, 
indicating that the PSC strategy of combining scans from 
neighbouring longitudes was particularly effective in the 
cross-scan direction. Indeed, the Figure suggests that the 
resolution in the cross-scan (horizontal) direction is if 
anything slightly higher than the resolution in the in-scan 
(vertical) direction. We have also checked the distribution of 
close pairs on the sky, and find no tendency for close pairs to 
lie preferentially near the ecliptic poles, where scans cross, 
and where the angular resolution might be expected to be 
high in all directions. 

Given the evidence of Figure 7, we assume that 
the IRAS beam is effectively isotropic, with an angular 
resolution of l!5. 

Independent of any a priori knowledge about the IRAS 
beam, the fact that there is a deficiency of close pairs in 
PSCz can be demonstrated by looking at the distribution 
of pairs as a function of depth. If the sample were 
complete, then the distribution of pairs with depth would be 
independent of pair separation, at least at pair separations 
small compared to the scale of the survey. Specifically, the 
expected number of pairs in some prescribed volume V of 
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the survey is, at pair separations small compared to the scale 
of the survey, 



expected number of pairs = C n{ri) 



(40) 



where the sum is over all galaxies i in the volume V , the 
quantity n{ri) is the selection function at the position 
of galaxy i, and C = /[I + ^(r)]d"^r is an integral over 
pair separations in the interval of interest. The distribution 
of pairs with depth is determined entirely by the factor 
^.n(ri), which is independent of pair separation, the 
factor C being a constant for any specified interval of pair 
separations. 

For the sample used in this paper, the PSCz high 
latitude sample at comoving depths 4.2-420 /i~^Mpc, for- 
mula (40) predicts that the 10, 25, 50 (median), 75, and 
90 percentile depths of close pairs should be 7.5, 11, 
19, 36, and 56/i~^Mpc respectively. By comparison, the 
median and maximum depths of the 7 pairs with transverse 
separation < 10/i^^kpc are 8 and 19^^^Mpc, indicating a 
significant deficiency of pairs, with of order 30 to 50 percent 
completeness, while the median and maximum depths of the 
34 pairs with transverse separations 10-30 /I'^kpc are 18 
and 56^~^Mpc, consistent with little or no deficiency, of 
order 90 percent completeness. 

The distribution of close pairs with depth is consistent 
with the hypothesis that there is a cutoff at ~ 1.'5. This 
angular separation corresponds to transverse separations of 
8 and 25/i~^kpc at the 50 and 90 percentile depths 19 
and 56/i~^Mpc of the survey. Thus if pairs closer than 1.'5 
are missing, then pairs at tranverse separation 8/i~^kpc 
should be 50 percent complete, and pairs at transverse 
separation 25/i~^kpc should be 90 percent complete. These 
levels of completeness are consistent with those inferred for 
observed pairs in the < 10 /i~^kpc and 10-30 /i~^kpc ranges 
of separation. 

We choose to deal with the incompleteness by imposing 
a sharp lower limit of ll5 in the angular separation of 
pairs, in both real and 'background' pair counts. Figure 8 
compares the power spectra measured with and without 
the 1^5 cutoff. At the smallest scales, the power spectrum 
without the cutoff is systematically lower than the canonical 
power spectrum with the cutoff. 

We caution that there is expected to be at least some 
incompleteness in pairs at angular separations ~ l.'5-5', 
so our estimate of the power spectrum at the smallest 
scales may be systematically underestimated. We hesitate 
to attempt to correct for this residual incompleteness, given 
the uncertainty in IRAS^s efi'ective beam. 

Whether the small scale power spectrum of PSCz galax- 
ies is systematically underestimated or not, it demonstrates 
dramatically that the power spectrum continues to small 
scales with no hint of any turnover such as expected in the 
matter power spectrum. 



4.3 Comparison of methods 

Figure 9 compares the power spectrum measured 
by the linear and nonlinear methods separately, demon- 
strating good agreement between the two methods where 
they overlap, around k ~ 0.3 ft Mpc~^. This agreement 
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Figure 9. Power spectrum of PSCz measured by different 
methods. Solid line at large scales k ^ 1 h Mpc" ^ is the correlated 
power spectrum measured by the linear method, and the shaded 
area its Icr limits. Points with error bars constitute the power 
spectrum measured by the nonlinear method through band-power 
windows ~ fc"e with n = 72. Solid line at small scales 
k ^ 10/iMpc— ^ is the power through band-power windows with 
n = 72 X 4 = 288. The resolution of the n = 288 power spectrum 
is A log k 1/24 fwhm, twice that of the n = 72 power spectrum. 
For both n = 72 and n = 288, the adopted maximum harmonic 
^max(fc) is given by equation (13), with the additional constraint 
that £ < 72 for n = 72. Thus the n = 288 power spectrum uses 
more harmonics at A; ^ 20/iMpc-^. 



constitutes a powerful end-to-end test of both methods, 
since they involve completely different approximations and 
computational approaches. 

Quantitative comparison is complicated by the fact 
that the band-power windows have somewhat different 
shapes for the linear and nonlinear methods. Moreover the 
nonlinear method assumes a weaker prior, since it allows 
higher harmonics of redshift power, so the errors on the 
nonlinear estimates might be expected to be slightly larger 
where both methods work well. However, the agreement 
is encouraging despite these differences. For example, the 
results for the two band-powers adjacent to the linear- 
nonlinear boundary are as follows. For the band-power 
centred at fc = 0.317 ft Mpc"'^, the linear and nonlinear 
methods yield P{k) = 917 ± 109 ft'^Mpc^ and P(fc) = 
908 ± 190ft-^Mpc^ respectively, a 1% mismatch in power 
and a 74% larger error for the nonlinear case. Similarly, for 
the band-power centred at fc = 0.365 ft Mpc"^, the linear 
and nonlinear methods yield P{k) = 674 ± 85 ft-'^Mpc'^ and 
P(fc) = 702 ± 102 ft-^Mpc^ respectively, a 4% mismatch 
in power, and a 20% larger error for the nonlinear case. 
Tightening the nonlinear prior by reducing the maximum 
number fmax of harmonics, equation (13), reduces the 
error bars in the nonlinear case, bringing them into closer 
agreement with the linear method. 

At linear scales the nonlinear method breaks down, in 
part because the plane-parallel approximation breaks down, 
but also because the band-power window we have used at 
nonlinear scales, ~ fc"e with n = 72, which has a fwhm 
of Alogfc ~ 1/12, becomes too narrow in low wavenumber 
band-powers to be resolved by the survey. We assess the 
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problem quantitatively by introducing an explicit maximum 
pair separation of « 270 /i~^Mpc, and computing the 
neglected contribution to monopole power from separations 
exceeding the limit. The neglected contribution increases 
with exponential rapidity at large scales, from a fractional 
correction of ~ 10~^° to the band-power at « 0.3 Mpc~^, 
to ~ 10""^ at ~ 0.2 /iMpc~^, to overwhelmingly dominant 
at ~ O.l^Mpc"^. This explains why the power computed 
by the nonlinear method is plotted only at fc ^ 0.2/iMpc~^ 
in Figure 9. 



At nonlinear scales the linear method breaks down, 
in part because both the assumption of Gaussian density 
fluctuations and the linear model of redshift distortions 
fail, but also because the number 4096 of Karhunen-Loeve 
modes used by HTP is, by design, sufficient to achieve good 
coverage of fc-space only up to A; ^ 0.3/iMpc~^. At larger 
wavenumbers the coverage of fc-space becomes increasingly 
sparse. This explains why the power computed by the linear 
method appears to become noisier at k ^ 0.5/iMpc~^, and 
why it is plotted only to fc 0.9/jMpc^^ in Figure 9. 



Figure 9 also compares the power spectrum measured 
by the nonlinear method using two different band-power 
windows, ~ fc"e"* with n = 72 and n = 288. The high 
resolution band-powers, n — 288, have resolution A log k ~ 
1/24 fwhm twice that of the low resolution band-powers, 
n = 72. Evidently the two sets of band-powers yield results 
in good agreement. We also experimented with n — 648, 
which has three times the resolution of n — 72; again the 
results were in good agreement. 



We also computed a power spectrum using the nonlinear 
method with n — 72 but with twice as many harmonics, 
^max = 32 (fc/1 ft Mpc"^)^''^, as the adopted maximum, 
equation (13). The power spectrum agrees well with the 
original calculation, but we choose to omit it from Figure 9 
to avoid confusing the plot. 



The maximum harmonic measurable with a band-power 
~ fc"e is ^ = n. The concern with the low resolution 
band-powers, n = 72, is that at large wavenumbers there 
are not enough harmonics to resolve the expected hill in 
the redshift power at /i = 0, the all-important place where 
redshift power equals real power. In fact equation (13) would 
suggest that, in order to resolve redshift power satisfactorily, 
harmonics £ > 72 are required at <; 20/iMpc~^, with 
i ~ 284 required at k — 316 hMpc~^ . One might anticipate 
that too few harmonics would tend to smooth out the hill, 
hence bias the estimate of real power systematically low. 
However, Figure 9 shows little sign that the lower resolution 
band-powers with n = 72 are biased low compared to the 
higher resolution band-powers with n = 288. Some bias 
surely remains, but it is apparently small compared to the 
statistical uncertainty. Since the low resolution band-powers 
have smaller error bars than the high resolution band-powers 
binned to the same resolution, we prefer the low resolution 
n = 72 band-powers at all nonlinear scales. 
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Figure 10. Comparison of the real space power spectra of the 
PSCz and APM (Gaztaiiaga & Baugh 1998) surveys. The APM 
power has been renormalized upward by a factor 1.25 (see text). 
Shaded region is the la uncertainty in the correlated power 
spectrum of PSCz. The lower panel shows the ratio 6apm/''psCz 
of the APM to PSCz bias, the square root of the ratio of their 
power spectra. The APM to PSCz bias is ftAPM/^PSCz ~ 1-15 at 
linear scales, k ^ 0.3/iMpc~^, increasing to feAPlvl/^'PSCz ~ 1-4 
at nonlinear scales, k ^ l.S/iMpc"'^. Compare this Figure to 
Figure 2 of Peacock (1997). 



4.4 Comparison to APM 

To date the best published measurement of the real space 
galaxy power spectrum is that of the APM survey* (Baugh 
& Efstathiou 1993, 1994; Maddox et al. 1996; Gaztafiaga 
& Baugh 1998, Table 2; Dodelson & Gaztafiaga 2000; 
Eisenstein & Zaldarriaga 2000). 

As discussed by Baugh & Efstathiou (1993) and 
Eisenstein & Zaldarriaga (2000), the APM survey has a 
median depth in redshift of z ~ 0.11, and transforming 
the power spectrum to zero redshift depends on cosmology. 
The main effect is that the redshift-distance relation is 
different in different cosmologies. The canonical APM power 
spectrum quoted by Baugh & Efstathiou, Gaztafiaga & 
Baugh, and Eisenstein & Zaldarriaga assumes a fiat matter- 
dominated cosmology, Q^n ~ 1. In a ACDM cosmology, 
f2m = 0.3, f^A — 0.7 (as assumed for the redshift-distance 
relation in our PSCz measurements), the power spectrum 



* The APM power spectrum in the present paper is taken 
from Table 2 of Gaztafiaga & Baugh (1998), who state that 
their tabulated numbers are essentially the same as those of 
Baugh & Efstathiou (1993). Eisenstein & Zaldarriaga (2000) have 
critiqued the error bars of Baugh & Efstathiou (1993, 1994), and 
to a lesser extent those of Dodelson & Gaztafiaga (2000), as 
overly optimistic, mainly because of the neglect of covariances. 
Unfortunately Eisenstein & Zaldarriaga limit their analysis to 
k ^ 0.8 hMpc~^ , so in the present paper we choose to quote the 
power spectrum of Gaztaiiaga & Baugh (1998). The Eisenstein & 
Zaldarriaga power spectrum has factor of 2 larger error bars, and 
scatters about more, than the Gaztaiiaga & Baugh spectrum, but 
the two measurements are otherwise consistent with each other. 
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would be ~ 20% higher. FoUowing Peacock (1997), we 
renormalize the APM power spectrum upward by a factor 
1.25, which according to Peacock brings it into agreement 
with the real space correlation function of the APM-Stromlo 
survey (Loveday et al. 1995). 

Figure 10 compares the real space power spectrum of 
PSCz to that of APM. The relative bias between APM and 
PSCz, defined as the square root of the ratio of their power 
spectra, reveals a suggestively simple pattern. At linear 
scales k ^ 0.3/iMpc~^ the relative bias is approximately 
constant, &apm/6pscz ~ 1.15. At transition scales k ~ 0.3- 
1.5 ftMpc-i the APM to PSCz bias increases, settling down 
at nonlinear scales k ^ 1.5/iMpc~^ to another constant, 
bAPu/bpscz ~ 1.4. 

Intriguingly, the APM to PSCz bias would have been 
close to unity at linear scales if we had not renormalized the 
APM power spectrum by Peacock's factor 1.25. However, we 
are persuaded that it is correct to renormalize. 

The fact that APM to PSCz bias is consistent 
with being constant at linear scales is an encouraging 
confirmation of the prediction of local bias models, that bias 
at large, linear scales should be scale-independent (Coles 
1993; Fry and Gaztanaga 1993; Scherrer & Weinberg 1998; 
Coles, Melott & Munshi 1999; Heavens, Matarrese & Verde 
1999). Scale- independence of bieis at linear scales is also a 
feature of A^-body experiments (Kravtsov & Klypin 1999; 
Colin et al. 1999; Narayanan, Berlind & Weinberg 2000; 
Benson et al. 2000). 

4.5 Power spectra from individual FKP 
weightings 

Figure 11 compares the power spectra measured from 
the five individual FKP pair- weightings (§3.10), with 
FKP constants J = 0, 10, 10^, 10^, and 10*/i~^Mpc^, 
equation (30). To show more detail, the lower panel of 
Figure 11 shows the bias of the power spectra, defined here 
to be the square root of the ratio of the power spectrum to 
the standard power spectrum of PSCz plotted in Figure 6 
and tabulated in Table Bl. Figure 11 demonstrates that 
there is a general consistency between the power spectra 
measured with different pair-weightings. 

Larger FKP constants J give greater effective weight to 
more distant regions of the survey, hence to more luminous 
galaxies. Figure 11 gives weak indication that power spectra 
measured with larger FKP constants have higher bias over 
the range ~ 2-20/iMpc~^, which in turns suggests weakly 
that /i^^S-luminous galaxies may be more clustered than 
less luminous galaxies at these scales. If this is correct, 
then it would suggest that the power spectrum of the 
more luminous IRAS galaxies may be similar to the power 
spectrum of APM galaxies. Figure 10. 

One should be careful not to overinterpret Figure 11. 
The fact that measurements for J = 10^ and 10^ h~^Mpc^ 
appear systematically high, at the l-2cr level, over the 
range k ^ 3-10 ft Mpc~^, might suggest that the difference 
is statistically significant. However, the power spectrum is 
highly correlated over this range, as seen in Figure 15 below, 
and the significance is more marginal than it appears. 

Figure 11 also gives some suggestion that power spectra 
with larger FKP constants J may switch to being biased low 
at smaller scales, k J; 20/!,Mpc~^. However, as is evident 



10^ 




10 30 100 300 



Wavenumber k (h Mpc ) 



Figure 11. (Upper panel) Power spectra measured with fixed 
FKP constants. (Lower panel) Corresponding bias, the square 
root of the ratio of the power spectrum to the standard 
power spectrum of PSCz plotted in Figure 6 and tabulated in 
Table Bl. The shaded region represents the Icr uncertainty in 
the standard power spectrum. The different curves correspond to 
FKP constants J = (solid), 10 (dot-dash), 10^ (long dash), 10^ 
(short dash), and lO** /i~'^Mpc^ (dotted). Larger FKP constants 
J give relatively more weight to more distant parts of the survey, 
i.e. to more luminous galaxies. The curve with the largest FKP 
constant, J = 10*/i~^Mpc^ (dotted), is plotted only up to 
k < 4hMpc~^, since its noisy criss-crossing confuses the plot 
at larger k. A selection of la error bars is shown in the lower 
panel. 



from the errors bars in the lower panel of Figure 11, the 
noise is really too great to tell. 

As discussed in Section 3.11, instead of compressing the 
five FKP-weighted estimates of each band-power directly, we 
first prewhiten the power, then compress, then unprewhiten, 
since in theory it is better to apply an FKP-like weighting 
to almost uncorrelated measure like the prewhitened power 
(HOO). The general effect of prewhitening before compressing 
is to prefer smaller FKP constants J, i.e. to give relatively 
more weight to nearer, less luminous galaxies. Figure 12 
shows the power spectra measured both with and without 
prewhitening before compression. The consequence on the 
power spectrum is for the most part small. The most 
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Figure 12. Comparison of measured nonlinear power spectra 
with and without prewhitening before FKP compression. The 
points with error bars are the standard power spectrum 
from Figure 6, in which the five FKP- weighted estimates of 
each band-power are first prewhitened, then compressed, then 
unprewhitened. The soUd Une is the power spectrum obtained 
from compressing the five FKP-weighted estimates directly, 
without the prewhiten-unprewhiten cycle. The two power spectra 
are in good agreement. 



noticeable effect is what might be expected on the basis of 
Figure 11: prewhitening before compressing decreases power 
by ~ 10% over the range k ^ S-lO/iMpc"^. 

Perhaps the greatest concern over luminosity-dependent 
bias is that it could bias the estimation of cosmological 
parameters. If more luminous galaxies are more clustered, 
then estimates of power at large scales, which depend more 
on distant, luminous galaxies, would be biased upward, 
giving the power spectrum a false red tilt. Encouragingly, 
Figure 11 shows no evidence of significant luminosity bias 
at scales k ^ l/iMpc"^. Although these measurements 
are restricted to the nonlinear regime, they do suggest 
that luminosity bias is probably not a major effect on the 
cosmological parameter analysis of Tegmark et al. (2001), 
which used PSCz data only at linear scales k < 0.3 h Mpc"^. 

Three recent studies, by Beisbart & Kerscher (2000), 
Szapudi et al. (2000), and Hawkins et al. (2001), have found 
no evidence of significant difference between the clustering of 
luminous and faint galaxies in the PSCz survey. Our results, 
while not constituting a formal study of differential biasing 
with luminosity, are consistent with the conclusions of these 
authors. 



4.6 Real space correlation function 

The correlation function ^(r) remains one of the most 
popular statistics for characterizing large scale structure 
(Peebles 1980). 

Figure 13 shows the real space correlation function 
of PSCz, obtained as the Fourier transform of the real 
space power spectrum shown in Figure 6. The covariance 




.01 .03 .1 .3 1 3 10 30 100 300 
Pair separation r (/z-'Mpc) 

Figure 13. Real space correlation function ^(r) of PSCz, 
obtained by Fourier transforming the real space power spectrum. 
The line is dashed where it is negative, at pair separations 50— 
250 /i" ^Mpc. The shaded region is not the Icr uncertainty in ^(r), 
but rather the envelope defined by the Fourier transforms of the 
correlated power spectrum and its ±lcr extremes. The dashed line 
is a power law {r /4:.27 h~^Mpc)~^-^^ . 



properties of the correlation function ^(r) are less than 
ideal, since there are broad correlations between estimates 
at different pair separations r. We make no attempt at a 
rigorous treatment of errors, and instead simply show in 
Figure 13 the envelope defined by the Fourier transforms of 
the correlated power spectrum and its rbla extremes. 

Table B3 tabulates the correlation function ^{r), the 
Fourier transform of the correlated power P{k) from 
Table Bl, and the correlation functions ^-{r) and ^+{r) 
which are the Fourier transforms of the zbla extremes 
P{k)±AP{k) of the correlated power from Table Bl. Notice 
that ^_ is not always less than and that ^_ and ^+ do 
not necessarily encompass the central value ^. 

We Fourier transform the power spectrum to the 
correlation function using the fast, logarithmically-spaced 
Fourier-Hankel method of Talman (1978), as implemented 
in the FFTLOG code described in Appendix B of HOO, 
and available at http://casa.colorado.edu/~ajsh/FFTLog/. 
Besides being able to cover a broader range of scales, the 
logarithmic FFT has the advantage that it does not suffer 
from the serious problem of ringing that afflicts the normal 
FFT when applied to cosmological power spectra (HOO, 
Fig. 12). 

To avoid artefacts arising from the periodicity in log 
space assumed by FFTLOG, we padded the power spectrum 
with a power law at each end to quadruple (double would 
have sufficed) the logarithmic interval, P{k) cx fe to fc = 
10-^/iMpc-\ and P{k) oc fc-^ "* to fc = lO^/iMpc'^ 
We then applied the most straightforward version of the 
FFTLOG transform, i.e. no power-law bias {q = 0), and a 
low-ringing value of kr. Finally, we retained only the central 
part of the correlation function ^(r), from r = 0.01 to 
300/i-^Mpc. 

A by-eye fit of the resulting correlation function to a 
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Figure 14. Points with error bars constitute tlie prewhitened 
power spectrum of PSCz. At linear scales, the points have 
been explicitly decorrelated. At nonlinear scales, the points are 
somewhat correlated, but less so than the (unprewhitened) power 
spectrum, as illustrated in Figure 15. The solid line is the 
power spectrum which, when prewhitened, equals the plotted 
prewhitened power spectrum. The dashed line is the linear (not 
nonlinear) concordance model power spectrum from Figure 6. 

power-law yields ^(r) « (r/ro)~^ with correlation length 
ro — 4.27 /i~^Mpc and index 7 — 1.55 over the range 
r = 0.01-20 /i"^Mpc. The fit is illustrated in Figure 13. 
The correlation function is a factor ~ 1.2 higher than, 
but has about the same slope as, the correlation function 
measured by Saunders et al. (1992), who found ro = 3.79 ± 
0.14/i~^Mpc and 7 = 1.57 ± 0.03 over pair separations 
r — 0.1-20 /i~^Mpc from a power law fit to the projected 
cross-correlation function between the QDOT survey (the 
l-in-6 precursor to PSCz) and its parent QIGC angular 
catalogue. Our power-law fit is also higher, but slightly 
shallower, than that of Fisher et al. (1994a), who inferred 
ro = 3.76t^;23 /i"^Mpc and 7 = IMtl^ over r = 1- 
20 ^~^Mpc from a power law fit to the projected correlation 
function of the IRAS 1.2 Jy survey. 

Fitting by eye is not satisfactory, but as in the case of 
the power spectrum, discussed at the end of Section 4.1, our 
attempt to carry out rigorous fits is thwarted by the fact 
that the covariance matrix measured at nonlinear scales is 
not positive definite (see §3.11 and Appendix B). The best 
that we have been able to do in terms of rigorous fitting at 
nonlinear scales is discussed in the following subsection, on 
the prewhitened power spectrum. 

4.7 Prewhitened power spectrum 

Nonlinear evolution induces broad correlations between 
estimates of power at different wavenumbers (Meiksin & 
White 1999; Scoccimarro, Zaldarriaga & Hui 1999; HOO). In 
effect, nonlinear evolution blurs whatever information may 
have been present in the linear power spectrum, such as 
baryonic wiggles (Meiksin, White & Peacock 1999). 

HOO showed that prewhitening (§3.9) the nonlinear 



Figure 15. Correlation coefficient Cj-j./ /(C^^^C^^^, ) of esti- 
mates of power (thin line) and of prewhitened power (thick line) 
in the PSCz survey. The six plots are the correlation coefficients 
between the power at k' = 0.32, 1, 3.2, 10, 32, and 100/iMpc~\ 
as labelled, and the power at other wavenumbers fc, as specified 
on the horizontal axis. By construction, the correlation coefficient 
is unity at fc = fc'. The Schwarz inequality requires that the 
correlation coefficient lie between 1 (perfect correlation) and 
— 1 (perfect anti-correlation). The covariance of power is near 
diagonal both at large, linear scales, where fluctuations are near- 
Gaussian, and at small, highly nonlinear scales, where shot 
noise dominates. At intermediate scales, notably at k' = 3.2 
and 10/iMpc~^, the power is highly correlated, whereas the 
prewhitened power is less so. 

power spectrum - transforming the power in such a way 
that the shot noise contribution to the covariance is 
proportional to the unit matrix - appears empirically to 
narrow the covariance of power substantially. The extent 
to which the prewhitened nonlinear power spectrum may 
be a better carrier of information than the nonlinear power 
itself remains to be explored, but whatever the case, the 
prewhitened power spectrum is less correlated, and therefore 
should offer better control of errors in fitting to cosmological 
models. 

Figure 14 shows the prewhitened power spectrum of 
PSCz, and Table B4 tabulates the corresponding values. 
Figure 14 also shows the linear (not nonlinear) concordance 
model power spectrum from Figure 6. As remarked by 
HOO, the prewhitened nonlinear power spectrum appears 
intriguingly similar to the underlying linear power spectrum, 
for realistic power spectra. It is not clear whether the 
similarity has some physical cause, or whether is is merely 
coincidental. 

At linear scales, the prewhitened power plotted in 
Figure 14 has been explicitly decorrelated (Hamilton 
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& Tegmark 2000), so that each point is uncorrelated 
with every other. The (unprewhitcnod) power spectrum 
shown in Figure 14 is the one that, when prewhitened, 
yields the plotted decorrelated prewhitened spectrum. The 
(unprewhitencd) power in Figure 14 is not the same as cither 
the correlated or uncorrelated powers shown in Figure 6; 
rather, it is that power which becomes decorrelated after 
being prewhitened. 

We also tried decorrelating the prewhitened power at 
nonlinear scales, but the measured prewhitened covariance 
matrix proved too noisy to admit believable decorrelation 
band-powers (§3.11). While the prewhitened powers at 
nonlinear scales are therefore somewhat correlated, it would 
be not unreasonable to treat them as being uncorrelated, or 
nearly so, in fitting to theoretical models. 

With the points treated as uncorrelated, a power law 
fit to the prewhitened power spectrum at nonlinear scales, 
k = 0.3-300 ft Mpc"S yields 

X{k) = (18.0 ±0.7) (A;/1.7/iMpc-')-^ "=^° °''?i-^Mpc^ (41) 

with = 34.8 for 46 degrees of freedom. The pivot point 
k = 1.7ftMpc~^ of the fit in equation (41) is chosen so 
that the error bars on the amplitude and exponent of the fit 
are essentially uncorrelated. The per degree of freedom 
of 35/46 is closer to one than the 25/59 for the power law 
fit to the power spectrum reported in Section 4.1, but the 
X^ remains lower than expected for uncorrelated points, 
suggesting that there remains some residual correlation in 
the estimates of prewhitened power. 

The fitted nonlinear slope —2.16 ± 0.04 of the prewhi- 
tened power would predict that the prewhitened correlation 
function would have a nonlinear slope of 3+ (— 2.16±0.04) = 
0.84 ± 0.04. According to the defining equation (24), the 
(unprewhitened) correlation function would then have a 
nonlinear slope of 7 = 2 x (0.84 ± 0.04) = 1.68 ± 0.08. 
This is slightly steeper than the by-eye slope of 7 ~ 1.55 
fitted to the correlation function in Section 4.6. Similarly, 
the nonlinear slope of the prewhitened power would predict 
that the power spectrum would have a nonlinear slope 
of (1.68 ± 0.08) - 3 = -1.32 ± 0.08, somewhat shallower 
than the slope —1.46 fitted directly to the power spectrum, 
equation (38). However, as discussed in Section 4.1, there is 
some suggestion that the power spectrum flattens to smaller 
scales, and the shallower slope predicted by the prewhitened 
power spectrum is consistent with such a flattening. 

Figure 15 shows the correlations between estimates 
of power, and between estimates of prewhitened power, 
measured in the PSCz survey. The plotted quantity is 
the correlation coefficient Cfefe//(C^^'^Cj,{^, ), which the 
Schwarz inequality implies must lie between —1 (perfect 
anti-correlation) and 1 (perfect correlation) . The covariances 
Cfcfc' of power estimates are measured from the fluctuations 
in the PSCz data themselves (§3.8), and are essentially free 
from prior assumption. The measurements properly take 
into account the correlation between different subregions of 
the survey. 

Figure 15 confirms that prewhitening the power 
spectrum narrows its covariance. However, the narrowing 
is not as good as found in analytic models by HOO, and we 
confess some disappointment at the result. One unexpected 
feature of the covariance plotted in Figure 15 is that the 



power at k' = 2>2h Mpc ^ appears somewhat anti-correlated 
with power at ~ 5 /i Mpc~^ . We have no explanation for this. 



5 CONCLUSIONS 

5.1 What we have done 

The paper combines two separate measurements at linear 
and nonlinear scales to yield a measurement of the real space 
power spectrum of the IRAS PSCz 0.6 Jy survey (Saunders 
et al. 2000) over four and a half decades of wavenumber. The 
linear measurement (HTP) assumes Gaussian fluctuations 
and that redshift distortions conform to the linear model, 
while the nonlinear measurement assumes the plane-parallel 
approximation, and infers the real space power spectrum 
from the redshift space power spectrum in the transverse 
direction. The measurements are tabulated in an Appendix. 

At nonlinear scales the power spectrum is broadly 
correlated over different wavenumbers, which not only blurs 
the information content of the power spectrum, but also 
complicates rigorous comparison to cosniological models. 
We therefore also report a measurement of the prewhitened 
power spectrum of PSCz, which is less correlated than 
the (nonlinear) power spectrum itself. To assist the reader. 
Appendix A contains practical instructions on how to 
prewhiten a power spectrum. 

5.2 Methodology 

We have shown how to exploit galaxy redshifts to measure 
the real space power spectrum with accuracy comparable to 
that attainable from an angular survey many times larger. 

We have successfully applied HOO's proposal to reduce 
the degree of correlation of the nonlinear power spectrum by 
prewhitening it. Statistical uncertainties in the covariance 
matrix of power estimates prevented complete decorrelation 
of the prewhitened nonlinear power spectrum. More reliable 
models, coupled with more precise measurements, of 
nonlinear covariance could permit full decorrelation in future 
analyses. 

By combining separate methods at linear and nonlinear 
scales, the present work completes the two-pronged program 
envisaged by Tegmark et al. (1998). The fact that there is a 
range of scales where the two methods overlap and agree well 
suggests that this two-pronged approach should be fruitful 
for ongoing projects such as the 2dF Survey and the Sloan 
Digital Sky Survey. 

5.3 What the results show 

The relative bias between optically-selected APM galaxies 
and IRAS-selected PSCz galaxies is consistent with being 
constant at linear scales, with &apm/6psCz ~ 1.15. The 
relative bias then rises to a second plateau &apm/&psCz « 1.4 
at nonlinear scales k ^ 1.5/iMpc^^. This is essentially the 
same behaviour as found by Peacock (1997). 

All Dark Matter models predict an inflection in the 
matter power spectrum at the transition between the linear 
and nonlinear regimes at fc ~ 0.3/iMpc~^, and a turnover 
at the transition from nonlinear collapse to the virialized 
regime at fc ~ 3 /iMpc~^. The PSCz galaxy power spectrum 
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shows neither of these features, but instead displays a near 
power-law behaviour to the smallest scales measured, with 
possible mild upward curvature in the broad vicinity of fc ~ 
2hM'pc~^. Short of a drastic revision of the current rather 
successful cosmological paradigm, the PSCz nonlinear power 
spectrum requires scale-dependent galaxy-to-mass bias: all 
Dark Matter models without scale-dependent bias are ruled 
out with high confidence. 

We caution that it is possible that we have underes- 
timated the PSCz power spectrum systematically at the 
smallest scales, k ^ 100/i~^Mpc, because IRAS's ~ 1^5 
resolution causes it to miss pairs at the smallest angular 
separations. Wc have attempted to remove most of the 
systematic by imposing a lower cutoff of 1.'5 in angular 
separation, but it is possible that a small residual systematic 
remains. 

The measured nonlinear power spectrum of PSCz 
clearly contains valuable information about galaxy-to-mass 
bias, and it will be a challenge for A^-body experiments 
to reproduce, and for theories to explain, the observed 
power spectra of both /i?j4S-selected and optically-selected 
galaxies (White et al. 1987; Kravtsov & Klypin 1999; Colm 
ct al. 1999; Narayanan, Bcrlind & Weinberg 2000; Benson 
et al. 2000; Ma & Fry 2000a,b; Seljak 2000, 2001; Peacock 
and Smith 2000; Scoccimarro et al. 2001). Because of the 
wide lever arm in wavenumber, it is possible that even fairly 
rudimentary models of nonlinear bias may allow interesting 
constraints to be placed on certain cosmological parameters, 
for instance on the primordial scalar spectral index n, or 
on deviations from power law behaviour in the primordial 
spectrum. 

If the Dark Matter paradigm is correct, then the fact 
that the observed power spectrum of PSCz galaxies is close 
to a power law over four orders of magnitude in wavenumber 
results from a cosmic conspiracy where the funny features 
in the nonlinear matter power spectrum are accurately 
cancelled by scale-dependent bias. It remains to be seen 
whether this is merely a cosmic coincidence or a hint of 
interesting underlying physics. 
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APPENDIX A: HOW TO PREWHITEN THE 
POWER SPECTRUM 

This part of the Appendix offers some practical hints on 
how to prewhiten a power spectrum numerically. We have 
had success with two different methods, described below. 
The first method uses a logarithmic Fast Fourier Transform 
technique to go from Fourier space to real space and back 
again, while the second uses a matrix method that works 
entirely in Fourier space. The two methods can provide a 
useful numerical check on each other. 



Al How to prewhiten power: Fourier method 

The method is: 

• Fourier transform the power spectrum P{k) to obtain 
the correlation function ^(r); 

• Transform the correlation function ^(r) to the pre- 
whitened correlation function X{r) in accordance with 

equation (24); 

• Fourier transform the prewhitened correlation function 
X{r) back to obtain the prewhitened power spectrum X{k). 

We strongly recommend using the logarithmic FFT (Talman 
1978; HOO, Appendix B), since the normal FFT suffers 
from serious ringing when applied to realistic cosmological 
power spectra (sec Fig. 12 of HOO). Whereas the normal 
FFT works on linearly spaced points, the logarithmic FFT, 
which we have implemented in a code FFTLoG available 
at http://casa.colorado.edu/~ajsh/FFTLog/, works on log- 
arithmically spaced points, easily covering ranges of orders 
of magnitude in wavenumber or pair separation with modest 
numbers of points. 

The logarithmic FFT assumes that the function (times 
some power law) is periodic in the log. To reduce artefacts 
arising from periodicity, we recommend padding the power 
spectrum at large and small scales (for example with a power 
law oc fe at large scales and a power law oc k" with n ~ 
—1.5 to —3 at small scales) to double the logarithmic range 
of interest, and then retaining only the central half of the 
transformed sequence. 

The FFTLoG code contains some options. We recom- 
mend the simplest choices, a zero bias exponent g = 0, and 
a low-ringing value of the relative phasing kr of the k and r 
logarithmic sequences. 

Warning (cf. HOO, §4.1): to avoid artefacts of ringing 
and aliasing, the Fourier method should not be applied over 
a narrow range of wavenumbers without padding. 
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are logarithmically spaced with spacing Alnfe, then the 
Fourier volume element is 



.1 .3 1 3 10 30 100 
Wavenumber A; (/zMpc"') 

Figure Al. Representative rows (or columns, since it is 
symmetric) of the prewhitening matrix, equation (A5), in Fourier 
space, appropriately discretized. At linear scales the prewhitening 
matrix goes over to the unit matrix. At nonlinear scales the 
prewhitening matrix looks like a high-pass filter. There is a 
sharp peak along the diagonal, superimposed on a valley that 
is deepest immediately adjacent to the diagonal. The amplitude 
of the diagonal peak appears to decline at larger wavenumbers 
because, in the discretized matrix, the peak is being cancelled by 
a deeper valley. 



A2 How to prewhiten power: matrix method 

If for some reason the Fourier method of §A1 is 
inconvenient, then the matrix method offers an alternative. 
The method is: 

• Construct the Fourier space version of the matrix which 
in real space is diagonal with diagonal entries 2/{l + [1 + 

• Apply this matrix to the power spectrum P{k). 

Figure Al illustrates that the prewhitening matrix in Fourier 
space looks essentially like a high-pass filter, which passes 
high frequency oscillations in the power, while reducing any 
smoothly varying component. 

Let A{ra,rii) denote the matrix which is diagonal in 
real space with diagonal entries ^(r) (HOG, eq. 58): 



(Al) 



Here Ssoira—rp) is the unit matrix in real space, a 3- 
dimensional delta function in pair separation r, satisfying 
J Ssoir) ^Tvr^dr = 1. In the Fourier representation the 
matrix A{ra,rp) transforms to (HOG, eq. 59): 



A{ka,ki3) = 



2 ^ ^ 



P{k) kdk 



(A2) 



To allow it to be manipulated numerically, the contin- 
uous matrix A{ka,ki3) must be discretized. To ensure 
that matrix operations (matrix multiplication, inversion, 
diagonalization, etc.) work in the usual way, discretization 
must be done in such a way that the inner product 
in continuous Fourier space, J d"^fc/(27r)^, translates into 
ordinary summation in the discrete space (HGG, §2.3). This 
leads to the discretization algorithm: for each index, q, on 
a vector, matrix, or tensor, multiply by the square root of 
the Fourier volume element, AV^^'^ ■ Thus A{ka,ki3) should 
be discretized by multiplying it by (AVq AVa)^''^: 

A^p = A{k^, kp) {AVc^AVpf^'' (A3) 
(no implicit summation). If, for example, points in fc-space 



AVo, = 47rfciAlnfc/(27r)^ 



(A4) 



From the discretized matrix Aap, construct the prewhi- 
tening matrix 



2 [l + (l 



.1/2 



a(3 



(A5) 



This involves the operations: (1) add the unit matrix 1^^ 
to Aq/j; (2) take the square root of the resulting matrix, 
(1 + aYJ^p , via an intermediate diagonalization; (3) add the 
unit matrix, to form lafj + (1 -|- A)^J^\ (4) invert, to get 
[1 + (1 + Af'^]-l- (5) multiply by 2. 

Note that 1 -I- ^(r) is necessarily positive, being an 
expectation value of products of positive densities in real 
space. Thus the matrix 1-1- A is necessarily positive definite, 
with all positive eigenvalues, and its square root (1 + A)^''^ 
is therefore always well-defined. 

Multiplying the power spectrum by the prewhitening 
matrix given by equation (A5) yields the prewhitened power 
spectrum. To make this work properly, the continuous power 
spectrum P{ka) must first be discretized into a vector Pc,: 

Pc = P(fc„) AV^^^ (A6) 

(no implicit summation). The discretized prewhitened power 
Xa is the matrix product of the prewhitening matrix, 
equation (A5), with the discretized power Pa, equation (A6): 



Xa = 2[l + il+A)'/']l^Pp (A7) 

(implicit summation over /3). Finally, undiscretize 

X{ka) = X^ AV-^I'^ (A8) 

(no implicit summation) to obtain the prewhitened power 
spectrum Xika)- 

The above prescription describes how to prewhiten 
the power spectrum by applying the prewhitening matrix 
2 -I- (1 -I- A)^''^] . This matrix is not the same as the 
matrix H = (1 -f A)^^''^ that prewhitens the covariance 
of power, equation (27). Consult equations (24)-(26) to see 
why this distinction arises. The prewhitening matrix H can 
be constructed in a manner similar to the prewhitening 
matrix 2 [H- (H- A)^/^] "\ 

Bug alert: be careful to discretize correctly. 



APPENDIX B: A (FAILED) ATTEMPT AT 
FISHER COMPRESSION 

This Appendix gives an illustrative example of the difficul- 
ties encountered when one tries to compress data (§3.11) 
using a covariance matrix which, being estimated from the 
data, contains statistical errors. The example is that of a 
single band-power, with a single FKP weighting, and the aim 
is to compress the measured even harmonics of the band- 
power down to a smaller number of harmonics. 

There are 37 measured even harmonics, up to f = 72. 
Assume, according to the prior, equation (13), that only 
even harmonics up to ^ < ^max are nonzero. The aim is then 
to compress the 37 harmonics down to (/max/2) + 1 even 
harmonics, in optimal fashion. 
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Let Pi (with hats) denote the measured amphtudes 
of the harmonics of the band-power, and let Cem = 
{APeAPm) denote their covariance matrix, in the present 
case also measured from the data (§3.8). Let Pi (without 
hats) represent the 'parameters' of the likelihood, the 
true amplitudes of the harmonics. If the harmonics were 
uncorrelated with each other, then the measured amplitudes 
Pi of the even harmonics up to £ < £max would provide 
the best estimates of Pe. But in reality the harmonics axe 
correlated, so measurements of higher harmonics can, in 
principle, inform values of lower harmonics. 

If the usual simplifying assumption is made that the 
measurements Pe arc Gaussianly distributed with fixed 
covariance matrix Cem, then maximizing the likelihood C oc 
is equivalent to minimizing 

= J2^Pi - DiPi)Ci^{Pm - DmPm) (Bl) 

Im 

where 73^ = 1 or as ^ < ^max or i > £max. The minimum 
solution of equation (Bl) is 

Pt = Y,F^ri.DmC;;^r.Pr. (B2) 

mn 

where Fem is the Fisher matrix of the parameters Pe 

Ftm = ^'^^ DeC^^Dm ■ (B3) 

Im 

Equations (B2) and (B3) constitute a simple example of 
Fisher compression, which in effect reduces here to inverse- 
variance weighting. Examination of equation (B2) shows 
(since the first (i?max/2) + 1 columns of DmC~^ (no implicit 
summation) are just equal to the Fisher matrix Fmn) 
that the 'improved' estimate Pe is equal to the measured 
amplitude Pe plus some linear combination of high order 
harmonics Pm with m > tmax- This makes physical sense: if, 
according to the prior, the higher order harmonics Pm with 
m > imax are all zero, then adding judicious combinations 
of them to the lower order harmonics can in principle yield 
more accurate estimates of the latter. 

Equations (B2) and (B3) are the theory. Reality is 
different. 

Consider what happens as one adds harmonics into the 
mix, one at a time, starting with just the harmonics with 
£ < ^max. The initial situation poses no problem: one is 
estimating harmonics up to £ < imax using estimates of 
harmonics up to ^ < ^max, and not surprisingly the best 
estimates are the measured values, Pe = Pe- Now add a 
harmonic, the one with i = £max-|-2. In most cases this 
works fine: the best estimate Pe of each harmonic acquires a 
small admixture of the new harmonic Pe,„^^+2, in accordance 
with equation (B2), and the variance of the best estimate 
Pe decreases by a small amount. As more and and more 
harmonics are folded into the mix, the variance creeps down. 
So far so good. Sooner or later, however, the Fisher matrix 
hits a negative eigenvalue. Although the negative eigenvalue 
does not necessarily cause immediate havoc, it is a sign 
of doom impending. Within a few more harmonics, the 
variance of the 'best estimate' has plummeted, even reaching 
negative values. Naturally one is skeptical that a negative 
eigenvalue could improve the estimate so. 

So how about the idea of stopping one step before 
the first negative eigenvalue appears? At first sight this 



seems to work fine, and one is encouraged to take 
the next step of computing the estimated real power 
P(/U=0)= ^^"p" P^P^(/i=0) from the appropriate hnear 
combination of best-fit harmonics Pe with Legendre poly- 
nomials Vtip-)- Typically, the variance of the best estimate 
of real power is about half the variance of the initial, 
pre-compression estimate. In a few cases the variance is 
reduced by as much as a factor of 4, apparently a serious 
improvement. 

Unfortunately the resulting 'best-fit' real power spec- 
trum does not live up to the advertising, scattering about 
unbelievably. 

Closer examination reveals the problem. The powers 
with the greatest claimed reduction in variance are the ones 
with the greatest admixtures of higher order harmonics. 
Peering yet closer, one finds that not only for these powers, 
but for all the others as well, the greatest reduction 
in variance occurs when some higher order harmonic is 
mixed in with unusually high weight. The behaviour is 
clearly spurious, an artefact of the compression ferreting out 
harmonic combinations that random errors in the covariance 
matrix have made appear artificially good. 

The problem appears generic: wherever the reduction 
in variance is greatest, it is least believable. So ends our tale 
of failed ambition. 
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Table Bl. Correlated Power Spectrum 
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k is the median wavenumber of the band-power window, and fe- and fc+ the wavenumbers where the band-power window falls to half its 
maximum. At linear scales, k < 0.33 /i Mpc^-'^ , the median and half-maximum points are those of the sealed and discretized band-power 
windows as defined in Hamilton & Tegmark (2000). At nonlinear scales, k > 0.33feMpc^^, the band-powers have the power law times 
Gaussian form detailed in Section 3.7. P(k) is the estimated power in the band-power, and AP(fc) its la uncertainty. 



Table B2. Decorrelated Lineaj: Power Spectrum 
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0.0366 


0.0308 





.0434 


8250. 


10800. 


0.178 


0.166 


0.190 


2980. 


570. 


0.0422 


0.0365 





.0492 


11700. 


9100. 


0.205 


0.192 


0.219 


1650. 


410. 


0.0485 


0.0423 





.0561 


19400. 


7600. 


0.237 


0.221 


0.254 


963. 


266. 


0.0560 


0.0491 





.0635 


10400. 


6000. 


0.274 


0.257 


0.292 


929. 


211. 


0.0646 


0.0569 


0, 


.0731 


4680. 


4550. 


0.316 


0.298 


0.335 


927. 


189. 



See footnote to Table Bl. When fitting to theoretical models at lineaj: scales, this decorrelated power spectrum is to be preferred over 
the correlated power spectrum of Table Bl, since the decorrelated estimates can be treated as uncorrelated. 
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Table B3. Correlation Function 



T 


s 


s— 


s+ 


T 


s 


s — 


s+ 


T 


s 


s — 


s+ 


(/t^^Mpc) 
















(/j^iMpc) 








0.00961 


16200. 


2980. 


26000. 


0.351 


31.9 


25.1 


38.7 


12.8 


0.191 


0.144 


0.238 


0.0111 


12500. 


2890. 


19800. 


0.405 


32.6 


25.1 


40.0 


14.8 


0.149 


0.107 


0.191 


0.0128 


9130. 


2790. 


14500. 


0.468 


31.1 


26.9 


35.3 


17.1 


0.127 


0.0886 


0.165 


0.0148 


6320. 


2670. 


10300. 


0.541 


24.4 


24.7 


24.0 


19.7 


0.106 


0.0751 


0.138 


0.0171 


4240. 


2520. 


7130. 


0.624 


19.8 


19.1 


20.6 


22.8 


0.0670 


0.0441 


0.0899 


0.0197 


3070. 


2360. 


5100. 


0.721 


13.4 


11.2 


15.6 


26.3 


0.0387 


0.0196 


0.0576 


0.0228 


2810. 


2170. 


4150. 


0.833 


11.5 


10.1 


12.9 


30.4 


0.0180 


4.87-3 


0.0310 


026S 


3070. 


1950. 


3890. 


0.961 


11.2 


10.7 


11.7 


35.1 


0.0154 


4 11 'i 

. J. J 3 


0.0267 


0.0304 


3070. 


1720. 


3570. 


1.11 


8.18 


7.60 


8.76 


40.5 


0.0154 


6.36-3 


0.0245 


0.0351 


2260. 


1480. 


2650. 


1.28 


6.12 


5.54 


6.70 


46.8 


0.0104 


4.33-3 


0.0164 


0.0405 


1170. 


1250. 


1510. 


1.48 


5.01 


4.31 


5.71 


54.1 


— 1.32_3 


—5 00 -i 


2.34-3 


0.0468 


931. 


1030. 


1150. 


1.71 


4.19 


3.77 


4.62 


62.4 


— 1.01-3 


—3.06-3 


1.02-3 


0.0541 


1160. 


841. 


1270. 


1.97 


3.67 


3.23 


4.12 


72.1 


8.83-4 


—3.26-4 


2.09-3 


0.0624 


841. 


660. 


974. 


2.28 


3.15 


2.67 


3.63 


83.3 


—4.06-4 


—8.97-4 


8.9-6 


0.0721 


577. 


486. 


687. 


2.63 


2.11 


1.77 


2.45 


96.1 


— 1.12-3 


—1.37-3 


—8.63-4 


0.0833 


364. 


336. 


447. 


3.04 


1.67 


1.41 


1.92 


111. 


—9.82-4 


—9.27-4 


—1.03-3 


0.0961 


435. 


250. 


562. 


3.51 


1.53 


1.32 


1.74 


128. 


—5.97 4 


—3.73 4 


—8.13 4 


0.111 


278. 


219. 


370. 


4.05 


1.09 


0.905 


1.28 


148. 


-4.91-4 


-2.47-4 


-7.34-4 


0.128 


282. 


207. 


343. 


4.68 


0.853 


0.709 


0.996 


171. 


6.05-4 


8.17-4 


3.87-4 


0.148 


198. 


155. 


247. 


5.41 


0.736 


0.609 


0.864 


197. 


-5.87-4 


-2.99-4 


-8.81-4 


0.171 


90.0 


58.0 


120. 


6.24 


0.592 


0.474 


0.709 


228. 


-5.91-4 


-4.41-4 


-7.41-4 


0.197 


91.5 


63.7 


120. 


7.21 


0.501 


0.408 


0.593 


263. 


2.23-4 


2.22-4 


2.27-4 


0.228 


86.5 


70.1 


103. 


8.33 


0.409 


0.327 


0.490 


304. 


3.31-4 


2.65-4 


3.95-4 


0.263 


76.6 


65.2 


88.2 


9.61 


0.319 


0.250 


0.389 


351. 


-1.53-4 


-1.84-4 


-1.25-4 


0.304 


45.3 


38.3 


52.3 


11.1 


0.286 


0.235 


0.337 











r is the pair separation, ^ tiic correlation function. ^- and ^+ arc not Icr limits, but rather they are the Fourier transforms of the ±1<t 
extremes P{k) ± AP(fc) of the correlated power from Table Bl. Notice that 5— is not always less than and that ^— and do not 
necessarily encompass the central value ^. 



Table B4. Prewhitened Power Spectrum 



k 


k- 


k+ 


P{k) 


AP(fc) 


k 


fe- 


k+ 


P{k) 


AP(fc) 


k 


k- 


k+ 


P{k) 


AP(fe) 




{h Mpc~ 






Mpc^) 




(ft.Mpc~ 




{h- 


3Mpc3) 


(ftMpc 






0.0183 


0.0130 


0.0220 


16900. 


49000. 


0.487 


0.441 


0.536 


212. 


47. 


13.3 


12.1 


14.7 


0.342 


0.071 


0.0219 


0.0165 


0.0264 


-9780. 


19800. 


0.562 


0.510 


0.619 


171. 


35. 


15.4 


14.0 


16.9 


0.245 


0.061 


0.0254 


0.0200 


0.0298 


34700. 


20000. 


0.649 


0.588 


0.715 


149. 


17. 


17.8 


16.1 


19.6 


0.0847 


0.0784 


0.0284 


0.0232 


0.0330 


34300. 


15400. 


0.750 


0.679 


0.825 


135. 


19. 


20.5 


18.6 


22.6 


0.0762 


0.0556 


0.0324 


0.0268 


0.0377 


5570. 


12000. 


0.866 


0.785 


0.953 


83.3 


12.6 


23.7 


21.5 


26.1 


0.0562 


0.0254 


0.0372 


0.0308 


0.0435 


7980. 


9870. 


1.00 


0.906 


1.10 


59.0 


11.3 


27.4 


24.8 


30.1 


0.0552 


0.0239 


0.0427 


0.0365 


0.0492 


11300. 


8400. 


1.15 


1.05 


1.27 


47.4 


6.6 


31.6 


28.7 


34.8 


0.0549 


0.0254 


0.0490 


0.0423 


0.0563 


18300. 


6940. 


1.33 


1.21 


1.47 


34.7 


5.1 


36.5 


33.1 


40.2 


0.0127 


0.0164 


0.0565 


0.0490 


0.0637 


9780. 


5420. 


1.54 


1.40 


1.69 


17.1 


3.3 


42.2 


38.2 


46.4 


1.69-3 


0.0116 


0.0653 


0.0567 


0.0734 


4550. 


4000. 


1.78 


1.61 


1.96 


18.1 


2.1 


48.7 


44.1 


53.6 


0.0117 


8.1-3 


0.0754 


0.0668 


0.0836 


9640. 


2990. 


2.05 


1.86 


2.26 


10.3 


2.2 


56.2 


51.0 


61.9 


0.0157 


8.7-3 


0.0871 


0.0781 


0.0950 


5880. 


2130. 


2.37 


2.15 


2.61 


9.08 


1.65 


64.9 


58.8 


71.5 


8.72-3 


5.98-3 


0.101 


0.0897 


0.110 


4020. 


1380. 


2.74 


2.48 


3.01 


5.79 


1.40 


75.0 


67.9 


82.5 


2.48-3 


5.59-3 


0.116 


0.105 


0.126 


4930. 


984. 


3.16 


2.87 


3.48 


4.06 


1.23 


86.6 


78.5 


95.3 


9.73-4 


3.20-3 


0.134 


0.122 


0.145 


2120. 


725. 


3.65 


3.31 


4.02 


4.73 


0.97 


100. 


90.6 


110. 


3.83-3 


2.92-3 


0.155 


0.142 


0.167 


2500. 


554. 


4.22 


3.82 


4.64 


2.74 


0.60 


115. 


105. 


127. 


8.92-4 


1.78-3 


0.178 


0.165 


0.192 


2400. 


409. 


4.87 


4.41 


5.36 


0.661 


0.443 


133. 


121. 


147. 


1.92-3 


1.80-3 


0.206 


0.190 


0.220 


1330. 


276. 


5.62 


5.10 


6.19 


1.23 


0.36 


154. 


140. 


169. 


1.12-3 


1.34-3 


0.238 


0.216 


0.258 


682. 


137. 


6.49 


5.88 


7.15 


1.12 


0.29 


178. 


161. 


196. 


-3.06-4 


1.12-3 


0.274 


0.253 


0.299 


628. 


106. 


7.50 


6.79 


8.25 


0.683 


0.182 


205. 


186. 


226. 


9.53-4 


8.85-4 


0.316 


0.295 


0.341 


671. 


109. 


8.66 


7.85 


9.53 


0.576 


0.193 


237. 


215. 


261. 


8.10-4 


5.14-4 


0.365 


0.331 


0.402 


459. 


92. 


10.0 


9.06 


11.0 


0.279 


0.172 


274. 


248. 


301. 


6.36-4 


4.51-4 


0.422 


0.382 


0.464 


348. 


63. 


11.5 


10.5 


12.7 


0.255 


0.098 


316. 


287. 


348. 


5.-6 


3.74-4 



See footnote to Table Bl. At linear scales k < 0.33 /iMpc"'^ the estimates of prewhitened power have been decorrelated. At nonlinear 
scales k > 0.33/iMpc~^ inaccuracies in the covariance matrix prevent full decorrelation, but it would not be unreasonable to treat the 
estimates of prewhitened power as uncorrelated or nearly so. 
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